-- Logs begin at Thu 2022-10-27 00:44:14 UTC, end at Thu 2022-10-27 01:54:15 UTC. -- Oct 27 01:15:28.945425 dv-cinder-815582-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 01:15:28.955090 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 01:15:28 2022] *** Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: nodename: dv-cinder-815582-19-iscsi Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: machine: x86_64 Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: clock source: unix Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: pcre jit disabled Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: detected number of CPU cores: 4 Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: current working directory: / Oct 27 01:15:28.957032 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: your processes number limit is 47680 Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: your memory page size is 4096 bytes Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: detected max file descriptor number: 2048 Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: lock engine: pthread robust mutexes Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: thunder lock: enabled Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 01:15:28.957734 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 01:15:28.996639 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: Python main interpreter initialized at 0x563dc17c99c0 Oct 27 01:15:28.996639 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: python threads support enabled Oct 27 01:15:28.996639 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: your server socket listen backlog is limited to 100 connections Oct 27 01:15:28.996639 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:15:28.996966 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:15:28.997048 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: *** Operational MODE: preforking *** Oct 27 01:15:28.997323 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:15:28.997323 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: spawned uWSGI master process (pid: 103861) Oct 27 01:15:28.997502 dv-cinder-815582-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 01:15:29.001278 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: spawned uWSGI worker 1 (pid: 103862, cores: 1) Oct 27 01:15:29.001278 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: spawned uWSGI worker 2 (pid: 103863, cores: 1) Oct 27 01:15:29.001278 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:15:29.654787 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 01:15:29.655397 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 01:15:30.733313 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:15:30.733313 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: from cryptography.utils import int_from_bytes Oct 27 01:15:30.733904 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:15:30.733904 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: from cryptography.utils import int_from_bytes Oct 27 01:15:30.734049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:15:30.734049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: from cryptography.utils import int_from_bytes Oct 27 01:15:30.734049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:15:30.734049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: from cryptography.utils import int_from_bytes Oct 27 01:15:33.239915 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:15:33.240493 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:15:33.240692 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:15:33.240819 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:15:33.241201 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:15:33.241304 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:15:33.241387 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:15:33.241688 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.241798 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:15:33.242009 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.242112 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:15:33.242327 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.242415 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:15:33.242645 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.242741 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.242973 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.243061 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.243279 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.243379 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.243647 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.244291 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.244693 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.244789 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.244883 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.244965 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245436 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245540 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245621 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245713 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245893 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-19-iscsi {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.245992 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246180 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246273 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246514 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246610 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246826 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-19-iscsi {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.246913 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247149 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247236 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247457 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247552 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247767 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.247853 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248066 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248151 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248375 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248561 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248698 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.248976 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249124 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249306 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249523 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249656 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.249955 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250139 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250276 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250449 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250578 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250784 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.250871 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251099 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251193 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251408 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251494 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251711 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.251822 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252023 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252118 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-19-iscsi {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252347 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252429 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252660 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252759 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.252993 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.253139 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-19-iscsi {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.253381 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.253485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.253693 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.253783 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254004 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254107 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254320 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254407 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254641 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254782 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.254946 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255034 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255267 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255359 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255580 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255667 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.255993 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256211 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256309 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256514 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256600 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256819 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.256920 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257155 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257246 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257471 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257570 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257773 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.257860 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258073 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258166 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258319 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258413 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258622 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258708 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.258938 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259060 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259226 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259363 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259537 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259634 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259833 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.259938 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260086 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260263 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260403 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260488 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260715 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260869 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.260967 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261051 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261293 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261380 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261614 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261739 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.261917 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262005 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262223 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262319 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262526 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262694 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262831 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.262924 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263134 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263226 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263440 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263536 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263748 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.263834 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264055 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264141 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264358 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264454 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264675 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264760 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.264998 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265116 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265327 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265413 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265633 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265720 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.265969 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266057 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266268 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266370 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266578 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266671 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266890 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.266976 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267210 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267298 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267515 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267602 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267816 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.267902 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268117 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268204 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268432 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268517 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268739 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.268834 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269048 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269174 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269319 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269405 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269620 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269737 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.269921 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270022 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270235 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270329 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270536 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270638 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270838 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.270934 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271147 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271243 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271445 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271551 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271750 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.271846 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272050 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272145 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272348 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272441 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272648 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272733 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.272951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273037 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273283 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273370 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273581 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273676 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273886 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.273974 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274185 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274271 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274484 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274569 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274809 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.274900 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275395 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275480 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275480 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275622 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275700 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275787 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.275998 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276110 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276307 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276416 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276622 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276708 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.276925 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277025 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277256 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277344 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277576 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277669 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277877 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.277965 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278177 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278263 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278490 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278576 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278791 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.278878 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279091 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279178 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279405 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279492 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279706 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.279810 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280010 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280103 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280321 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280616 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280707 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.280913 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281027 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281247 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281353 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281651 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281853 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.281949 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282151 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282261 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282445 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282530 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282743 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.282829 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283037 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283133 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283336 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283421 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283640 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283727 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.283938 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284032 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284239 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284324 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284540 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284627 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284855 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.284940 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.285190 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.285289 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.285498 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.285594 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.285818 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:15:33.285906 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286144 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286230 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286475 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286559 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286802 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.286937 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287118 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287212 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287426 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287521 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287738 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.287823 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288059 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288146 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288367 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288467 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288676 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288762 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.288984 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289101 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289322 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289487 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289635 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289728 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.289951 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.290059 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.290260 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.290353 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291176 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291583 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291668 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291747 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291826 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.291959 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292128 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292244 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292451 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292561 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292765 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.292874 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293107 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293218 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293441 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293539 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293763 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.293869 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294074 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294172 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294415 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294515 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294730 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.294829 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295040 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295139 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295349 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295447 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295657 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295763 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.295977 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296074 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296289 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296399 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296596 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296696 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.296944 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297070 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297263 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297379 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297579 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297685 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297885 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.297982 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298193 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298305 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298500 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298808 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.298905 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299113 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299218 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299422 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299519 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299734 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.299832 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300043 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300150 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300351 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300448 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300658 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300756 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.300971 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301098 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301308 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301420 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301620 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301721 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.301927 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.302039 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.302232 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.302335 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.302534 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.302634 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303109 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303226 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303410 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303711 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.303803 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304016 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304109 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304323 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304416 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304626 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304719 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305041 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305269 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305379 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305577 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305679 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305883 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.305977 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.306739 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.306837 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307108 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307219 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307417 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307517 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307727 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.307821 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308033 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308138 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308347 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308440 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308657 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308750 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.308961 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309092 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309308 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309403 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309618 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309720 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.309920 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310012 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310231 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310325 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310534 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310626 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310839 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.310932 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311146 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311239 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311452 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311544 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311772 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.311889 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312070 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312161 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312378 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312493 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312702 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.312799 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313018 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313131 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313346 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313511 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313670 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313758 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.313992 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314079 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314295 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314393 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314596 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314689 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314905 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.314992 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315208 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315305 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315511 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315598 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315812 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.315898 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316115 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316201 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316412 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316498 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316713 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.316798 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317018 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317134 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317344 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317442 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317646 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317731 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.317952 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318039 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318256 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318342 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318557 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318641 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318857 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.318942 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319158 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319286 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319463 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319565 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319768 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.319855 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320073 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320174 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320419 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320526 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320722 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.320810 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.321040 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.321145 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.321375 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.321476 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.321716 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322225 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322225 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322395 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322395 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322669 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322752 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322830 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.322967 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323104 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323287 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323421 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323599 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323737 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.323915 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324051 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324223 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324373 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324544 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324687 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.324850 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325009 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325208 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325348 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325514 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325675 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325826 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.325988 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326161 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326310 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326492 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326615 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326805 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.326932 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327129 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327260 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327435 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327589 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327745 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.327908 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328050 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328231 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328356 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328542 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328664 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328858 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.328972 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329191 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329311 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329503 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329620 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329816 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.329935 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330128 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330243 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330448 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330545 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330756 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.330857 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331076 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331162 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331387 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331473 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331709 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.331797 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332019 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332105 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332338 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332433 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332642 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332739 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.332951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333046 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333308 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333406 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333612 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333697 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.333917 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334004 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334223 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334322 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334528 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334615 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334828 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.334924 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335135 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335233 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335442 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335527 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335744 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.335835 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336047 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336133 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336348 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336435 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336660 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336745 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.336967 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.337085 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.337315 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.337469 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.337945 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338086 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338195 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338308 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338434 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338620 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338743 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.338929 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339064 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339236 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339468 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339564 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339778 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.339876 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340080 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340168 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340400 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340708 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.340818 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341010 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341119 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341353 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341445 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341657 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341754 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.341981 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342111 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342288 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342377 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342585 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342762 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.342893 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343002 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343207 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343314 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343515 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343616 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343822 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.343914 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344127 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344215 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344530 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344742 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.344829 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345049 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345176 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345376 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345467 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345684 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345771 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.345990 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346077 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346300 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346392 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346608 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346695 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.346922 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347019 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347224 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347310 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347531 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347618 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347838 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.347936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348141 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348229 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348447 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348535 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348758 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.348853 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.349114 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.349367 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.349464 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.349696 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.349783 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350007 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350095 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350323 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350566 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350654 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.350902 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351011 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351216 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351306 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351535 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351625 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351884 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.351985 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352186 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352282 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352491 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352587 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352792 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.352883 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.353839 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354115 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354207 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354286 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354445 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354533 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354750 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.354838 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355051 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355138 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355359 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355453 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355657 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355745 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.355958 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356047 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356260 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356355 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356560 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356648 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356861 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.356947 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357192 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357285 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357501 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357598 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357801 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.357887 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358115 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358210 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358418 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.358809 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359023 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359120 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359326 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359415 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359639 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359726 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.359947 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360045 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360255 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360344 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360561 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360650 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.360910 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361032 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361227 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361314 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361533 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361628 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361852 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.361947 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362152 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362269 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362455 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362546 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362752 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.362842 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363058 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363152 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363360 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363454 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363663 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363752 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.363967 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364062 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364274 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364366 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364576 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364668 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364874 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.364966 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365205 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365310 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365512 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365606 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365811 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.365903 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366116 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366230 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366420 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366514 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366715 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.366809 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367012 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367209 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367327 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367412 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367634 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367722 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.367931 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.368036 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.368231 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.368334 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.368559 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369232 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369502 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369595 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369740 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369833 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.369988 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370079 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370286 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370378 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370591 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370681 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.370894 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371067 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371191 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371281 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371491 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371666 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371802 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.371981 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372112 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372284 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372415 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372585 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372738 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.372889 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373050 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373231 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373376 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373532 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373681 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373842 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.373996 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374144 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374300 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374456 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374607 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374756 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.374918 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375061 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375242 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375363 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375656 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375864 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.375952 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376173 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376261 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376481 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376571 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376785 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.376873 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377099 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377206 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377412 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377510 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377707 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.377794 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378009 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378106 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378313 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378402 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378610 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378698 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378910 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.378997 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379208 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379296 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379525 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379621 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379830 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.379927 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380135 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380231 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380438 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380535 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380763 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.380859 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381091 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381230 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381407 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381495 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381716 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.381814 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382025 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382114 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382325 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382414 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382638 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382739 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.382946 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383035 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383256 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383348 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383555 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383656 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383855 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.383953 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384190 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384286 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384504 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384601 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384802 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.384878 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385137 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385230 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385458 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385547 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385767 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.385853 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386065 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386152 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386370 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386460 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386678 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386773 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.386989 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387077 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387293 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387380 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387595 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387685 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387900 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.387997 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388206 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388292 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388509 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388596 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388815 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.388910 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389141 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389229 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389446 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389546 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389751 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.389849 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390055 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390144 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390356 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390443 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390662 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390762 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.390965 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391053 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391265 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391353 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391566 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391653 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391864 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.391951 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392169 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392276 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392469 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392565 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392774 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.392887 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393095 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393245 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393407 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393497 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393719 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.393808 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394093 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394186 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394399 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394494 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394711 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.394800 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395019 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395117 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395318 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395406 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395626 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395732 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.395943 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396107 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396257 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396355 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396562 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396650 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.396916 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397013 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397242 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397331 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397548 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397683 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397868 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.397970 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398167 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398255 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398464 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398552 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398762 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.398852 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.399077 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.399165 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.399377 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.399466 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.399682 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.400274 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.400504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.400617 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.400829 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.400924 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401161 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401254 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401485 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401638 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401901 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.401991 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402212 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402301 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402515 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402602 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402839 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.402955 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403161 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403259 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403461 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403559 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403769 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.403858 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404071 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404173 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404390 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404480 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404708 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.404797 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405014 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405130 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405346 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405436 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405646 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405742 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.405963 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406069 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406269 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406356 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406583 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406704 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.406882 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407068 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407204 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407304 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407525 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407614 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407838 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.407931 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408160 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408250 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408514 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408602 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408818 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.408908 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409139 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409231 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409448 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409537 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409748 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.409838 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410047 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410136 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410365 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410454 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410665 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410762 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.410970 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411059 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411272 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411367 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411574 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411665 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411872 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.411968 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412171 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412268 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412479 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412574 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412775 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.412863 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413094 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413199 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413405 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413494 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.413816 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414029 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414125 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414326 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414416 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414643 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414733 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.414949 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.415038 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.415251 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.415340 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416119 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416247 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416426 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416658 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416768 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.416981 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417101 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417318 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417417 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417629 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417719 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.417940 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418032 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418289 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418387 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418598 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418686 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.418920 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419010 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419242 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419375 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419549 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419639 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419864 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.419954 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420185 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420275 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420486 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420574 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420786 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.420875 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421110 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421205 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421416 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421506 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421714 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.421811 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422014 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422103 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422317 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422406 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422613 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422716 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.422913 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423001 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423214 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423312 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423616 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423815 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.423910 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424120 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424207 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424422 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424723 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.424826 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425023 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425158 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425348 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425447 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425668 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425756 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.425974 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426068 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426277 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426366 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426582 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426678 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426886 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.426981 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.427203 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.427292 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.427514 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.427603 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428088 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428184 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428397 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428492 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428706 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.428801 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429018 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429151 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429352 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429442 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429660 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429755 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.429970 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430071 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430279 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430368 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430590 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430678 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.430904 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.431124 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.431259 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.431579 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.431841 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.431930 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.432158 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.432257 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.432470 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.432707 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.432796 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433037 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433156 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433378 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433477 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433693 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433783 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.433998 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434095 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434307 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434404 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434613 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434703 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.434920 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435016 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435230 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435319 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435540 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435639 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435851 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.435941 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436167 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436255 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436480 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436569 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436791 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.436883 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437123 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437217 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437451 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437539 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437769 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.437867 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438071 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438197 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438382 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438480 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438693 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.438782 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439003 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439093 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439313 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439410 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439623 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439712 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.439932 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440021 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440240 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440330 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440550 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440643 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440863 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.440952 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441211 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441304 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441517 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441616 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441826 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.441916 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442135 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442226 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442446 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442543 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442752 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.442849 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443063 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443153 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443375 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443465 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443697 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.443896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444016 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444214 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444330 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444550 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444639 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.444879 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445177 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445271 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445494 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445583 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445828 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.445969 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446154 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446242 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446459 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446549 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446785 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.446878 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447095 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447207 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447538 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447637 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447841 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.447929 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448143 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448231 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448455 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448552 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448757 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.448845 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449072 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449161 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449390 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449487 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449698 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.449916 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450006 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450257 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450571 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450669 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.450893 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451123 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451212 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451472 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451569 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451791 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.451880 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452109 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452195 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452412 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452510 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452715 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.452805 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453028 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453202 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453358 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453484 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453658 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.453957 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454045 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454262 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454359 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454623 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454725 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454860 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.454950 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455164 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455254 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455463 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455552 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455786 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.455875 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456088 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456179 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456389 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456478 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456688 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456786 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.456996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457151 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457422 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457632 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457734 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.457935 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458023 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458233 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458320 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458538 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458636 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458837 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.458927 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459140 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459227 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459439 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459537 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459747 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.459844 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460048 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460136 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460357 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460459 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460661 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460758 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.460974 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461080 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461301 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461391 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461602 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461704 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.461915 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.462013 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.462223 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.462965 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463057 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463218 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463330 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463636 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463734 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.463941 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464028 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464271 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464360 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464582 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464693 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.464892 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.465130 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.465276 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.465466 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.465591 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.465784 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466116 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466204 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466443 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466532 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466748 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.466840 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467051 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467141 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467353 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467443 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467673 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467763 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.467976 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468063 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468283 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468386 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468587 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468674 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468893 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.468982 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469226 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469327 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469532 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469620 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469837 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.469924 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.470139 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.470235 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.470716 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.470716 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.470887 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471030 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471128 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471339 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471429 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471646 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471735 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.471952 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472255 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472342 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472561 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472651 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472869 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.472965 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473204 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473297 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473531 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473619 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473845 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.473936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474158 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474247 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474464 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474553 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474769 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.474859 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475072 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475164 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475375 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475478 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475681 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475776 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.475988 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476077 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476298 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476387 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476599 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476689 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.476919 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.477255 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.477348 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.477589 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478077 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478184 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478300 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478391 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478622 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478722 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.478943 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479040 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479257 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479347 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479580 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479678 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.479902 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480000 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480214 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480310 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480535 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480625 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480846 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.480935 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481199 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481291 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481525 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481622 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481832 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.481929 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482142 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482257 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482446 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482550 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482752 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.482839 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483054 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483151 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483359 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483447 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483662 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.483964 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484066 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484269 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484359 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484568 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484655 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484865 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.484965 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485189 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485282 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485487 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485574 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485787 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.485887 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486085 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486173 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486386 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486476 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486684 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486779 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.486979 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487069 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487278 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487365 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487576 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487664 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487875 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.487962 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488177 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488265 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488478 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488569 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488777 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.488870 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489091 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489181 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489394 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489485 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489693 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.489780 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490039 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490143 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490323 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490412 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490637 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490725 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.490944 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491047 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491262 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491349 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491563 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491658 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491880 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.491975 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492189 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492277 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492496 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492583 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492801 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.492898 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.493133 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.493222 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.493445 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494081 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494414 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494603 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494735 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.494910 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495048 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495214 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495361 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495519 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495671 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495843 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.495980 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496167 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496288 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496473 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496620 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496794 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.496948 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497133 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497282 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497452 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497607 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497765 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.497925 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498077 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498245 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498403 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498557 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498708 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.498866 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499018 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499195 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499324 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499506 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499631 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499817 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.499938 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500127 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500250 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500436 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500554 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500746 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.500861 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501074 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501210 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501394 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501523 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501706 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.501844 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502022 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502167 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502335 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502473 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502660 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502792 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.502985 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503117 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503298 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503454 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503621 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503753 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.503946 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504091 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504290 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504415 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504602 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504723 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.504949 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.505038 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.505308 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.505408 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.505574 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:15:33.505662 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.505919 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.506224 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:15:33.506467 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:15:33.659013 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Registered counter for database nova_api Oct 27 01:15:33.659587 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO dbcounter [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Registered counter for database nova_api Oct 27 01:15:33.680552 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.682432 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_db.sqlalchemy.engines [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.687288 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.689146 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writer thread running {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.745041 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.context [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79e0fc89-c477-4f65-9016-7985d4fd2534(cell1) {{(pid=103862) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:15:33.746669 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.context [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79e0fc89-c477-4f65-9016-7985d4fd2534(cell1) {{(pid=103863) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:15:33.748855 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:15:33.749369 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:15:33.750725 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:15:33.750970 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:15:33.751353 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:15:33.751676 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:15:33.752122 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:15:33.753036 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:15:33.753773 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:15:33.754139 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:15:33.754243 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:15:33.756118 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Registered counter for database nova_cell0 Oct 27 01:15:33.756216 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:15:33.758277 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO dbcounter [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Registered counter for database nova_cell0 Oct 27 01:15:33.760909 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Registered counter for database nova_cell1 Oct 27 01:15:33.763302 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO dbcounter [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Registered counter for database nova_cell1 Oct 27 01:15:33.768300 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.770977 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.772088 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_db.sqlalchemy.engines [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.774460 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.777531 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writer thread running {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.778163 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_db.sqlalchemy.engines [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.913762 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.916619 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writer thread running {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.923888 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Registered counter for database nova_cell0 Oct 27 01:15:33.925085 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO dbcounter [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Registered counter for database nova_cell0 Oct 27 01:15:33.931429 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.934950 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_db.sqlalchemy.engines [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:15:33.936165 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:33.939579 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writer thread running {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:15:34.275263 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: WARNING keystonemiddleware.auth_token [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:15:34.276644 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:15:34.282468 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: WARNING keystonemiddleware.auth_token [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:15:34.283816 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:15:34.624380 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: WARNING keystonemiddleware.auth_token [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:15:34.628455 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:15:34.630249 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: WARNING keystonemiddleware.auth_token [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:15:34.634501 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-256c03aa-57c2-4743-b1b6-5d35078c6bf4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:15:34.635485 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563dc17c99c0 pid: 103863 (default app) Oct 27 01:15:34.637559 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:15:34.638728 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Oct 27 01:15:34.639125 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Oct 27 01:15:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:15:34.639742 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563dc17c99c0 pid: 103862 (default app) Oct 27 01:16:56.496784 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:16:56.497839 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 27 01:16:56.498242 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:16:56.510699 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:56.511642 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell1:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:56.512666 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell0:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:56.514623 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:16:57.402644 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-1ed1d613-e208-4ce2-9bb8-a90a867f0b58 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:16:57.435354 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-1ed1d613-e208-4ce2-9bb8-a90a867f0b58 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930129 Oct 27 01:16:57.436080 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 01:16:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:00.091801 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:00.092793 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-970455da-6c0e-4c12-973e-e9a2277b5700 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001384 Oct 27 01:17:00.093221 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:00.564136 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6219982f-7c2d-4c3b-b1a8-be139e2aca8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:00.615638 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6219982f-7c2d-4c3b-b1a8-be139e2aca8d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.515683 Oct 27 01:17:00.616193 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:17:00.630491 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_api:SELECT=3 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.632597 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_cell0:SELECT=3 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.633553 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_cell1:SELECT=3 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.634283 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:00.840920 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-a3b7978b-d390-4fbd-aad8-2675dbe1f472 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:00.912246 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-a3b7978b-d390-4fbd-aad8-2675dbe1f472 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287039 Oct 27 01:17:00.912906 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 01:17:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:03.576398 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6219982f-7c2d-4c3b-b1a8-be139e2aca8d admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:03.577461 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6219982f-7c2d-4c3b-b1a8-be139e2aca8d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 27 01:17:03.577863 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:04.263678 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-055deb1c-5602-4bf0-9424-b1fd4b8e8acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:04.304864 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-055deb1c-5602-4bf0-9424-b1fd4b8e8acd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.719312 Oct 27 01:17:04.306655 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:17:04.317939 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-1cbb0f92-2820-4c4a-8a56-3c0e27cb79c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:04.357848 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-1cbb0f92-2820-4c4a-8a56-3c0e27cb79c2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044097 Oct 27 01:17:04.358448 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 01:17:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:06.976699 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-055deb1c-5602-4bf0-9424-b1fd4b8e8acd admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:06.977755 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-055deb1c-5602-4bf0-9424-b1fd4b8e8acd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 27 01:17:06.978167 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:07.397158 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-ad1ccb53-0161-49ed-9814-de46afb98ffe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "ram": 1024}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:07.417704 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-ad1ccb53-0161-49ed-9814-de46afb98ffe admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432567 Oct 27 01:17:07.418274 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:07.431546 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-5209be9b-3dbd-49c2-9d74-621ec7505e12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:07.463743 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-5209be9b-3dbd-49c2-9d74-621ec7505e12 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035838 Oct 27 01:17:07.464327 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 01:17:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:17:10.102207 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-ad1ccb53-0161-49ed-9814-de46afb98ffe admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:10.103224 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-ad1ccb53-0161-49ed-9814-de46afb98ffe admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 27 01:17:10.103609 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:10.530104 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-cdbbe8f8-9c3f-4d5b-ab4d-c619cfc688df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "id": "d3", "swap": 0}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:10.549411 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-cdbbe8f8-9c3f-4d5b-ab4d-c619cfc688df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439877 Oct 27 01:17:10.550153 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:10.562123 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-491693a8-d677-47a4-9583-26b444e31533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:10.591423 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-491693a8-d677-47a4-9583-26b444e31533 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032853 Oct 27 01:17:10.591996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 01:17:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:13.281553 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-cdbbe8f8-9c3f-4d5b-ab4d-c619cfc688df admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:13.282797 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-cdbbe8f8-9c3f-4d5b-ab4d-c619cfc688df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Oct 27 01:17:13.283272 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:13.763049 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "name": "ds4G", "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:13.782063 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489988 Oct 27 01:17:13.782602 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:17:13.797104 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-68bb1efb-6f70-458c-bc63-d08ca324b2c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:13.827683 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-68bb1efb-6f70-458c-bc63-d08ca324b2c7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035945 Oct 27 01:17:13.828310 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Oct 27 01:17:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:16.421051 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:16.422103 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 27 01:17:16.422503 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:16.872569 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-c134b70f-2eed-4e33-92ce-143d09fd48cf admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:16.897981 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-c134b70f-2eed-4e33-92ce-143d09fd48cf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468652 Oct 27 01:17:16.898771 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 01:17:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:19.630965 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:19.631887 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-14e8d9ee-ab4c-4f7c-b06b-812ebe731dc4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 27 01:17:19.632286 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:20.029634 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-7da8545b-f025-4e34-b15a-4cda39723c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "name": "m1.tiny", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:20.052311 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-7da8545b-f025-4e34-b15a-4cda39723c4a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.414127 Oct 27 01:17:20.052951 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:20.064777 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-1bd15caf-39fc-4439-879e-7181f9db7add admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:20.093112 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-1bd15caf-39fc-4439-879e-7181f9db7add admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031886 Oct 27 01:17:20.093688 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 01:17:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:22.695623 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-7da8545b-f025-4e34-b15a-4cda39723c4a admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:22.696630 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-7da8545b-f025-4e34-b15a-4cda39723c4a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 27 01:17:22.697026 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:23.074813 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6e65b1bc-9746-4a8a-bbdd-15a876c2f445 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:23.094014 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6e65b1bc-9746-4a8a-bbdd-15a876c2f445 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.390886 Oct 27 01:17:23.094570 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 01:17:23.106641 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-bb4d4ee8-e66c-4dab-bd88-3d6409e88abc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:23.130483 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-bb4d4ee8-e66c-4dab-bd88-3d6409e88abc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027466 Oct 27 01:17:23.131048 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 01:17:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:25.793295 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6e65b1bc-9746-4a8a-bbdd-15a876c2f445 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:25.794509 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6e65b1bc-9746-4a8a-bbdd-15a876c2f445 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Oct 27 01:17:25.794974 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:26.252552 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-7c859612-3972-4dcc-854f-3067d2ff4ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:26.276726 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-7c859612-3972-4dcc-854f-3067d2ff4ba1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474663 Oct 27 01:17:26.277343 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:26.292156 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-44726d53-03c2-4a8c-b7b2-8cd0daa7410a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:26.324712 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-44726d53-03c2-4a8c-b7b2-8cd0daa7410a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037918 Oct 27 01:17:26.325791 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 01:17:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:17:28.996999 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-7c859612-3972-4dcc-854f-3067d2ff4ba1 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:28.998084 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-7c859612-3972-4dcc-854f-3067d2ff4ba1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Oct 27 01:17:28.998489 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:29.452520 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-e97a7bc3-1d62-42e3-b0a5-9e9aac67ba73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "name": "m1.large"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:29.460932 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:29.477216 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-e97a7bc3-1d62-42e3-b0a5-9e9aac67ba73 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472078 Oct 27 01:17:29.477982 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:29.490632 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-968ad308-5445-4cfd-a7f0-60e18ae135f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:29.517051 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-968ad308-5445-4cfd-a7f0-60e18ae135f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030779 Oct 27 01:17:29.517051 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 01:17:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:17:32.185652 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-e97a7bc3-1d62-42e3-b0a5-9e9aac67ba73 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:32.186657 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-e97a7bc3-1d62-42e3-b0a5-9e9aac67ba73 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 27 01:17:32.187054 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:32.636813 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "swap": 0, "ram": 16384}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:32.646400 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:32.665160 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471865 Oct 27 01:17:32.665974 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Oct 27 01:17:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:32.679420 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-9af8e255-7b06-44e7-9a56-dc1960bc2615 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:32.707453 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-9af8e255-7b06-44e7-9a56-dc1960bc2615 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033247 Oct 27 01:17:32.717645 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Oct 27 01:17:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:17:49.854297 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:49.855295 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 27 01:17:49.855691 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:49.866588 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:17:50.240092 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6b87cace-519a-4415-84c8-085eb47fe3ce admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:50.258306 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6b87cace-519a-4415-84c8-085eb47fe3ce admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396734 Oct 27 01:17:50.258827 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 01:17:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:51.546035 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:51.547051 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-84467242-4b68-48de-a471-3ed8a15bef7e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 27 01:17:51.547475 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:52.084345 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-d7657667-28ee-4739-850b-bca85fb15a91 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:52.089561 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-d7657667-28ee-4739-850b-bca85fb15a91 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-d7657667-28ee-4739-850b-bca85fb15a91 admin admin] Request method failure captured: Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept: application/json Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Connection: keep-alive Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Content-Length: 0 Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Host: 10.222.0.42 Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABjWdw_zmHx3a5QdVAI8dfSELIBT9HxzIX0uvbgicAoYVyX3YwQsXO54Re1OUEx_X5gXh2sJTZSKcoFvkqxVf3DyKerA8GxpB256R1DOzFbTdFnpzhxek0T-maC_qgPBkLpeo2ZN-YqADGCN79PlNxj8GQZHjSnVNsG3kkfNshOOQbs-ls Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Id: None Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Name: None Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Name: admin Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Role: admin,member,reader Oct 27 01:17:52.092721 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Roles: admin,member,reader Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant: admin Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User: admin Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Name: admin Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: method: > Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: exception: Flavor 42 could not be found. Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: action_args: {'id': '42'} Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:52.094432 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:52.095332 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.097392 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-d7657667-28ee-4739-850b-bca85fb15a91 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:52.098469 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-d7657667-28ee-4739-850b-bca85fb15a91 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400676 Oct 27 01:17:52.098469 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 01:17:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:52.104976 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-387053e2-6251-4336-afdb-b9a5a55ca502 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:52.126795 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-387053e2-6251-4336-afdb-b9a5a55ca502 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026247 Oct 27 01:17:52.127368 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:52.137771 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-24ad87ea-ddd2-4124-af68-243560dace08 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:52.160687 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-24ad87ea-ddd2-4124-af68-243560dace08 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027345 Oct 27 01:17:52.161255 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:17:52.170287 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-30b0b61f-327a-4232-8b27-1bf802a5169a admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:52.175717 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.wsgi [None req-30b0b61f-327a-4232-8b27-1bf802a5169a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-30b0b61f-327a-4232-8b27-1bf802a5169a admin admin] Request method failure captured: Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept: application/json Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept-Encoding: gzip, deflate Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Connection: keep-alive Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Content-Length: 0 Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Host: 10.222.0.42 Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-System-Scope: None Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: User-Agent: python-novaclient Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Auth-Token: gAAAAABjWdw_zmHx3a5QdVAI8dfSELIBT9HxzIX0uvbgicAoYVyX3YwQsXO54Re1OUEx_X5gXh2sJTZSKcoFvkqxVf3DyKerA8GxpB256R1DOzFbTdFnpzhxek0T-maC_qgPBkLpeo2ZN-YqADGCN79PlNxj8GQZHjSnVNsG3kkfNshOOQbs-ls Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Id: None Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Name: None Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Identity-Status: Confirmed Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Is-Admin-Project: True Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Id: default Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Name: Default Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Name: admin Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Role: admin,member,reader Oct 27 01:17:52.178936 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Roles: admin,member,reader Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant: admin Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Name: admin Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User: admin Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Id: default Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Name: Default Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Name: admin Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: method: > Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: exception: Flavor 42 could not be found. Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: action_args: {'id': '42'} Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:52.180504 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:52.181518 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:52.182835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-30b0b61f-327a-4232-8b27-1bf802a5169a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:52.184067 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-30b0b61f-327a-4232-8b27-1bf802a5169a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013495 Oct 27 01:17:52.184067 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 01:17:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:53.387513 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-24ad87ea-ddd2-4124-af68-243560dace08 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:53.388675 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-24ad87ea-ddd2-4124-af68-243560dace08 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Oct 27 01:17:53.389099 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:53.910359 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-e6fc5d08-4c92-42ae-9571-553f92e28c1d admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:53.915309 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.wsgi [None req-e6fc5d08-4c92-42ae-9571-553f92e28c1d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-e6fc5d08-4c92-42ae-9571-553f92e28c1d admin admin] Request method failure captured: Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept: application/json Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept-Encoding: gzip, deflate Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Connection: keep-alive Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Content-Length: 0 Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Host: 10.222.0.42 Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-System-Scope: None Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: User-Agent: python-novaclient Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Auth-Token: gAAAAABjWdxBW4BfO8_97MifAP3wiSXuZDCKm7krZLvycDUpyTDuWTuI79VJNzYFizvhd0izTSoOLDnuaqYFfAKvKaau9ijGNS-SNvmE1rIHaUL1mmoB6Gjza37GKBc8urGHq5wFUwZDSVz19FnJyuXWk7BFIsAyp-FH6Xa0mqw_cYOFjxNyDtE Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Id: None Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Name: None Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Identity-Status: Confirmed Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Is-Admin-Project: True Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Id: default Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Name: Default Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Name: admin Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Role: admin,member,reader Oct 27 01:17:53.916792 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Roles: admin,member,reader Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant: admin Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Name: admin Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User: admin Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Id: default Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Name: Default Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Name: admin Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: method: > Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: exception: Flavor 84 could not be found. Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: action_args: {'id': '84'} Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:53.918352 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:53.919458 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.920751 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-e6fc5d08-4c92-42ae-9571-553f92e28c1d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:53.922122 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-e6fc5d08-4c92-42ae-9571-553f92e28c1d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392024 Oct 27 01:17:53.922122 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 01:17:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:53.927933 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-c4c6aeb6-4321-4016-bc3f-a75640c2434b admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:53.942942 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-c4c6aeb6-4321-4016-bc3f-a75640c2434b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018760 Oct 27 01:17:53.943468 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:53.952606 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-d07f88d2-50dd-4bff-b38d-e98b6c3c6666 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:53.968200 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-d07f88d2-50dd-4bff-b38d-e98b6c3c6666 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019057 Oct 27 01:17:53.968721 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:53.978227 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6a2ad554-5627-4dee-b783-9d928ce33332 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:53.983144 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-6a2ad554-5627-4dee-b783-9d928ce33332 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6a2ad554-5627-4dee-b783-9d928ce33332 admin admin] Request method failure captured: Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept: application/json Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Connection: keep-alive Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Content-Length: 0 Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Host: 10.222.0.42 Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABjWdxBW4BfO8_97MifAP3wiSXuZDCKm7krZLvycDUpyTDuWTuI79VJNzYFizvhd0izTSoOLDnuaqYFfAKvKaau9ijGNS-SNvmE1rIHaUL1mmoB6Gjza37GKBc8urGHq5wFUwZDSVz19FnJyuXWk7BFIsAyp-FH6Xa0mqw_cYOFjxNyDtE Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Id: None Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Name: None Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Name: admin Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Role: admin,member,reader Oct 27 01:17:53.984640 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Roles: admin,member,reader Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant: admin Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User: admin Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Name: admin Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: method: > Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: exception: Flavor 84 could not be found. Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: action_args: {'id': '84'} Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:53.986293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:53.987556 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:53.988951 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6a2ad554-5627-4dee-b783-9d928ce33332 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:53.990316 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6a2ad554-5627-4dee-b783-9d928ce33332 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011277 Oct 27 01:17:53.990316 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Oct 27 01:17:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:55.182317 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-d07f88d2-50dd-4bff-b38d-e98b6c3c6666 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:55.183322 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-d07f88d2-50dd-4bff-b38d-e98b6c3c6666 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 27 01:17:55.183720 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:55.698616 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5b99d75e-1618-4818-b547-9a1f83f1072f admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:55.704293 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-5b99d75e-1618-4818-b547-9a1f83f1072f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5b99d75e-1618-4818-b547-9a1f83f1072f admin admin] Request method failure captured: Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept: application/json Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Connection: keep-alive Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Content-Length: 0 Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Host: 10.222.0.42 Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABjWdxDk9T1xpmAKPN7Inoz4JyXz7M3BvE3umgSWNw_l_NeEfZPKbmfjxv-58v_GYXe4c8F2VFB8GfoiBOAb_JnK4EYMx5FZ3EdfG8S7MXxoUTEmSzmEocx5wv9Y1mOqZdz80vLXSfbZKb-lxDIZmkgiV3lzPt0rQtgjazbFIk_FbKo3Xw Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Id: None Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Domain-Name: None Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Project-Name: admin Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Role: admin,member,reader Oct 27 01:17:55.706485 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Roles: admin,member,reader Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant: admin Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User: admin Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: X-User-Name: admin Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: method: > Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: exception: Flavor 451 could not be found. Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: action_args: {'id': '451'} Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:55.708020 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:55.708896 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.709996 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5b99d75e-1618-4818-b547-9a1f83f1072f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:55.710984 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5b99d75e-1618-4818-b547-9a1f83f1072f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388910 Oct 27 01:17:55.710984 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:17:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:55.717708 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-444e53ef-ad2c-41e1-8aeb-3853a86f8cb7 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:55.735290 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-444e53ef-ad2c-41e1-8aeb-3853a86f8cb7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021026 Oct 27 01:17:55.735839 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:55.745743 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:55.761404 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019214 Oct 27 01:17:55.761927 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Oct 27 01:17:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:17:55.771673 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-740f249d-d123-43aa-81d2-57b90a75e1a2 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:55.776559 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.wsgi [None req-740f249d-d123-43aa-81d2-57b90a75e1a2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-740f249d-d123-43aa-81d2-57b90a75e1a2 admin admin] Request method failure captured: Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept: application/json Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Accept-Encoding: gzip, deflate Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Connection: keep-alive Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Content-Length: 0 Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Host: 10.222.0.42 Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-Api-Version: compute 2.92 Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Openstack-System-Scope: None Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: User-Agent: python-novaclient Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Auth-Token: gAAAAABjWdxDk9T1xpmAKPN7Inoz4JyXz7M3BvE3umgSWNw_l_NeEfZPKbmfjxv-58v_GYXe4c8F2VFB8GfoiBOAb_JnK4EYMx5FZ3EdfG8S7MXxoUTEmSzmEocx5wv9Y1mOqZdz80vLXSfbZKb-lxDIZmkgiV3lzPt0rQtgjazbFIk_FbKo3Xw Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Id: None Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Domain-Name: None Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Identity-Status: Confirmed Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Is-Admin-Project: True Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Id: default Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Domain-Name: Default Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Project-Name: admin Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Role: admin,member,reader Oct 27 01:17:55.778078 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Roles: admin,member,reader Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/062e383759c34ca3b52c150dd337a6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_062e383759c34ca3b52c150dd337a6ba", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant: admin Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Id: 062e383759c34ca3b52c150dd337a6ba Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-Tenant-Name: admin Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User: admin Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Id: default Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Domain-Name: Default Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Id: fe01809d18f644f9bc72669fc872b53d Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: X-User-Name: admin Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: method: > Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: exception: Flavor 451 could not be found. Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: action_args: {'id': '451'} Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:17:55.779560 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:55.780423 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: ERROR nova.api.openstack.wsgi Oct 27 01:17:55.781505 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-740f249d-d123-43aa-81d2-57b90a75e1a2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:17:55.782787 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-740f249d-d123-43aa-81d2-57b90a75e1a2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011816 Oct 27 01:17:55.782787 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:17:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:56.985871 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:56.987441 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 27 01:17:56.987845 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:57.507033 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-cadd29de-ae07-4edc-81b6-205d45d2596b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:57.527274 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-cadd29de-ae07-4edc-81b6-205d45d2596b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398721 Oct 27 01:17:57.527821 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 01:17:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:17:58.738298 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:17:58.739362 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 27 01:17:58.739759 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:17:59.265835 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-ad6b94cf-ed4e-4a12-b0f1-6bb51324cbf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:17:59.285205 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-ad6b94cf-ed4e-4a12-b0f1-6bb51324cbf8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408502 Oct 27 01:17:59.285748 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 01:17:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:18:00.491407 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:18:00.492505 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Oct 27 01:18:00.492957 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:18:01.013940 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-5ca7c4bf-569e-41df-b9a2-52c56010ab8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:18:01.032373 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-5ca7c4bf-569e-41df-b9a2-52c56010ab8d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400792 Oct 27 01:18:01.032907 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 01:18:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:18:02.250538 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:18:02.251553 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 27 01:18:02.251952 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:18:02.768279 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-84536424-bb47-4d27-addc-1769281abaf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:18:02.787446 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-84536424-bb47-4d27-addc-1769281abaf4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397350 Oct 27 01:18:02.788022 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Oct 27 01:18:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:18:03.994040 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:18:03.995053 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 27 01:18:03.995445 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:18:04.509939 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-e492b046-a067-4afb-9c60-d2d917396b93 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:18:04.530542 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-e492b046-a067-4afb-9c60-d2d917396b93 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399174 Oct 27 01:18:04.531071 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Oct 27 01:18:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:01.265997 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.267002 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-020d7d0d-8bbe-4458-a030-7699c85f2117 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 27 01:19:01.267575 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:19:01.278712 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:19:01.656388 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-b8d89458-3f0b-4331-93d4-3b9a8116bc3b admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.676377 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-b8d89458-3f0b-4331-93d4-3b9a8116bc3b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402079 Oct 27 01:19:01.676965 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:19:01.699398 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=14 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:19:01.703089 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-4d567ee6-d4f4-41ce-9385-a961abd9f88f admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.711518 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-4d567ee6-d4f4-41ce-9385-a961abd9f88f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013953 Oct 27 01:19:01.712035 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:01.723567 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-36c4ed91-04f1-477f-af0d-d08391311bd4 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.730774 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-36c4ed91-04f1-477f-af0d-d08391311bd4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010764 Oct 27 01:19:01.731286 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:01.742271 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.749259 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010374 Oct 27 01:19:01.749759 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:19:01.761383 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-d95df433-b614-4447-8d72-3b64ce01552e admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:19:01.768273 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-d95df433-b614-4447-8d72-3b64ce01552e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010302 Oct 27 01:19:01.768778 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Oct 27 01:19:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:21:54.832642 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:54.833927 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 27 01:21:54.834325 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:54.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_api:SELECT=6 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:21:55.139613 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:55.144262 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:21:55.144730 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:21:55.145196 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:21:55.145969 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:21:55.146378 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:21:55.146788 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:21:55.177947 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-9c957e31-2b67-4526-89fb-cc4538271339 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.198289 Oct 27 01:21:55.178663 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:21:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:21:56.241868 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.242859 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 27 01:21:56.243248 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:21:56.446785 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:21:56.450207 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:21:56.450617 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:21:56.451037 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:21:56.451731 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:21:56.452169 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:21:56.452577 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:21:56.471980 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-b5706c69-e205-48c2-aeea-32d529ffb517 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078710 Oct 27 01:21:56.472530 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:21:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:22:07.953171 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:07.954265 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 27 01:22:07.954657 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:08.099769 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_cell0:SELECT=4 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:22:08.100403 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_cell1:SELECT=4 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:22:08.101128 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG dbcounter [-] [103863] Writing DB stats nova_api:SELECT=8 {{(pid=103863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:22:08.148104 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:08.151483 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:22:08.151993 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:22:08.152426 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:22:08.153164 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:22:08.153614 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:22:08.154032 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:22:08.180049 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-c6c5791e-c9ec-4e6e-bf6f-814a04eb7d0d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.085416 Oct 27 01:22:08.180599 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:22:08 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:22:09.240913 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:09.241931 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f018cf09-9cb2-42cf-ac13-1a02d3d050b0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 27 01:22:09.242323 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Oct 27 01:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:22:09.434804 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG nova.api.openstack.wsgi [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Calling method '>' {{(pid=103863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:22:09.438210 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:22:09.438678 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:22:09.439100 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:22:09.439795 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:22:09.440232 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:22:09.440640 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: DEBUG oslo_concurrency.lockutils [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:22:09.462727 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: INFO nova.api.openstack.requestlog [None req-1d11b495-172b-4d2c-9aac-cefc010711df admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078822 Oct 27 01:22:09.463193 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: [pid: 103863|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Oct 27 01:22:09 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:23:07.041142 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: Thu Oct 27 01:23:07 2022 - graceful shutdown triggered... Oct 27 01:23:07.041273 dv-cinder-815582-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 01:23:07.042434 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: Gracefully killing worker 1 (pid: 103862)... Oct 27 01:23:07.042869 dv-cinder-815582-19-iscsi devstack@n-api.service[103863]: Gracefully killing worker 2 (pid: 103863)... Oct 27 01:23:07.169773 dv-cinder-815582-19-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=4 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:08.043527 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: worker 1 buried after 1 seconds Oct 27 01:23:08.043527 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: worker 2 buried after 1 seconds Oct 27 01:23:08.043527 dv-cinder-815582-19-iscsi devstack@n-api.service[103861]: goodbye to uWSGI. Oct 27 01:23:08.045032 dv-cinder-815582-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 01:23:08.045682 dv-cinder-815582-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 01:23:08.048423 dv-cinder-815582-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 01:23:08.070791 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 01:23:08 2022] *** Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: nodename: dv-cinder-815582-19-iscsi Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: machine: x86_64 Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: clock source: unix Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: pcre jit disabled Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: detected number of CPU cores: 4 Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: current working directory: / Oct 27 01:23:08.073355 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: detected binary path: /usr/bin/uwsgi-core Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: your processes number limit is 47680 Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: your memory page size is 4096 bytes Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: detected max file descriptor number: 2048 Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: lock engine: pthread robust mutexes Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: thunder lock: enabled Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 01:23:08.074187 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 01:23:08.116858 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: Python main interpreter initialized at 0x55c16956d9c0 Oct 27 01:23:08.116858 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: python threads support enabled Oct 27 01:23:08.116858 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: your server socket listen backlog is limited to 100 connections Oct 27 01:23:08.116858 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: your mercy for graceful operations on workers is 90 seconds Oct 27 01:23:08.117376 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 01:23:08.117376 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: *** Operational MODE: preforking *** Oct 27 01:23:08.117644 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: *** uWSGI is running in multiple interpreter mode *** Oct 27 01:23:08.117644 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: spawned uWSGI master process (pid: 118886) Oct 27 01:23:08.118462 dv-cinder-815582-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 01:23:08.118734 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: spawned uWSGI worker 1 (pid: 118905, cores: 1) Oct 27 01:23:08.119232 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: spawned uWSGI worker 2 (pid: 118906, cores: 1) Oct 27 01:23:08.120289 dv-cinder-815582-19-iscsi devstack@n-api.service[118886]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 01:23:08.781509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 01:23:08.801457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 01:23:10.035947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:23:10.035947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: from cryptography.utils import int_from_bytes Oct 27 01:23:10.036557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:23:10.036557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: from cryptography.utils import int_from_bytes Oct 27 01:23:10.043480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:23:10.043480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: from cryptography.utils import int_from_bytes Oct 27 01:23:10.043928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 01:23:10.043928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: from cryptography.utils import int_from_bytes Oct 27 01:23:12.484857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:23:12.485472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:23:12.485669 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:23:12.486049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:23:12.486315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:23:12.486710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.487046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.487375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.487704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.488044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.488363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.488692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.489020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.489391 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.489658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.490005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.490345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-19-iscsi {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.490680 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.490994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.491312 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.491639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.491949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.492282 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.492596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.493126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.493591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.493908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.494228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.494575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.494897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.495214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.495542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.495860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.496191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.496519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.496922 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-19-iscsi {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.497271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.497590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.497908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.498329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.498646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.498963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.499292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.499624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.499941 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.500199 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 01:23:12.500603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.500696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 01:23:12.500782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.500911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.501019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 01:23:12.501264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.501410 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 01:23:12.501577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.501671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 01:23:12.501893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.502851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.503988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504752 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.504994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.505181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.505295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506247 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-19-iscsi {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.506889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.507828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508152 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.508969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509133 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.509930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510247 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510346 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510885 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.510979 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.511937 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-19-iscsi {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.512897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.513888 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.514877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515090 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515657 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.515976 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.516919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517263 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517876 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.517979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.518841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.519999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.520935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.521702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.521914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522343 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.522975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.523896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524216 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524428 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.524854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525493 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.525806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526744 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.526950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.527995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.528914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.529870 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530178 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.530946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.531991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.532192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.532299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.532495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.532596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.532801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.532894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.533130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.533238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.533442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.533570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.533750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.533913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.534057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.534242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.534363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.534564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.534667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.534887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.534990 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.535223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.535323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.535544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.535637 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.535867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.535981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.536183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.536274 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.536493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.536631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.536844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.536947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.537211 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.537329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.537528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.537629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.537850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.537942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.538157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.538249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.538465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.538559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.538785 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.538878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.539091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.539199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.539394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.539488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.539716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.539809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.540023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.540124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.540331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.540424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.540651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.540750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.540952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.541084 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.541284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.541377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.541601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.541702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.541961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.542081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.542209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.542303 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.542512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.542613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.542817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.542917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.543119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.543213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.543423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.543541 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.543715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.543864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.544014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.544197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.544300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.544519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.544621 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.544840 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.544934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.545189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.545283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.545512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.545614 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.545831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.545941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.546147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 01:23:12.546245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.546496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.546589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.546813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.546913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547232 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.547882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548199 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548529 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.548832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.549792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.550977 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.551903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552014 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.552933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.553965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.554931 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.555140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.555242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.555474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.555569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556766 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.556989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557747 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.557965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558376 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.558915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559010 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.559959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560506 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560823 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.560925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.561911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.562829 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563753 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.563976 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.564909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.565868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.566951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.567108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.567201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.567406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.567508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.567728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.568399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.568692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.568826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.568922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.569819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570686 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.570777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.571946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.572993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.573996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574211 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.574963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575322 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.575874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576169 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.576994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.577934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.578970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.579882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580204 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580541 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.580845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581404 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.581817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582145 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.582975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583390 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.583973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.584918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.585981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.586887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.587852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588167 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588690 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.588998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.589970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590071 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590696 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.590917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591235 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.591951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.592891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.593906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.594827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595768 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.595975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.596965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597847 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.597954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.598881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.599611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.599761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.599991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600724 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.600945 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.601872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.602870 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.603795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.604969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.605934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606643 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.606966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.607174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.607407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.607550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.607781 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.607876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.608943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.609111 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.609412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.609608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.609719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.609931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.610909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.611186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.611342 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.611540 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.611696 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.611864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.612898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613787 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.613881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.614083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.614188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.614409 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.614534 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.615270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.615389 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.615606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.615713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.615926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616245 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616451 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.616902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.617168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.617412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.617684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.617863 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.617968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.618860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.619111 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.619254 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.619491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.619600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.619892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.620002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.620172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.620269 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.620568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.620677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621210 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.621809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622026 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622120 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.622988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623410 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.623933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.624980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625529 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.625929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.626887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.627893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628466 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.628965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629226 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.629952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.630105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.630253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.630494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.630638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.630799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631198 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.631918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.632942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.633885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634358 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.634975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635823 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.635927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636259 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.636892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637266 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.637828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638143 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.638944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639249 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.639984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.640891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.641870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.642815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643137 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.643975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.644912 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.645864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.646469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.646786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647635 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.647961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648125 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648785 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.648922 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649584 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.649922 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650058 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650533 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.650844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651489 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.651916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.652314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.652480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.652653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.652823 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.652986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.653393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.653708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.654070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.654411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.654745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.655078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.655393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.655717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.656146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.656344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.656679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657729 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.657842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.658826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659143 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659749 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.659843 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.660135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.660448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.660557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.660781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.660883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.661130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.661240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.661452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.661641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.662419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.662550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.662774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.662904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663267 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663758 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.663898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664282 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.664951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665185 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665294 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.665917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666534 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.666864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.667827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668782 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.668989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.669999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670427 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.670971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.671974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672285 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.672933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673391 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.673915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.674965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.675911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676523 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.676833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.677087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.677216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.677440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.677836 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.677942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.678887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.679889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.680112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.680289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.680450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.680605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.680765 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681621 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.681911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682055 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682389 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.682894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.683960 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684247 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.684997 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.685176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.685397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.685505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.685710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.685804 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686680 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.686994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687088 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687640 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.687960 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.688923 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.689997 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.690925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.691863 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.692832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693449 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.693926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.694902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695056 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.695953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.696818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.697003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.697177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.697359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.697539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.697906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.698976 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699407 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.699949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.700951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701506 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.701960 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702143 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702255 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.702877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.703935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.704965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.705962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706058 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.706917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707235 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.707970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.708181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.708264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.709882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710062 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710367 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.710933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.711903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712272 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.712863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.713869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714282 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.714962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.715913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716443 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.716847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717744 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.717840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.718987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.719252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.719376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.719591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.719816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.719924 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720267 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.720949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.721900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722220 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722428 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.722836 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723054 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723150 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723766 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.723982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.724125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.724842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.725919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.726834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.727962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.728983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.729953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730453 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.730942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731307 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.731938 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.732974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.733860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.734085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.734185 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.734419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.734551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.734741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735445 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735765 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.735998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736752 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.736946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.737917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.738970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739164 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739807 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.739933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.740815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.741984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742077 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742294 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.742925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743865 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.743962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.744901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.745887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746755 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.746848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.747836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.748798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.749988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750428 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.750964 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751893 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.751989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.752943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.753879 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754196 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.754799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.755983 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.756840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757194 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.757826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.758956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.759060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.759288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.759421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.759685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.759783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.760004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.760110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.760253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:23:12.760360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.760630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.760956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.761293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.761619 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.761945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.762262 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.762573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.762913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.763227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.763642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.763964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.764286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.764600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.764913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.765274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.765605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.765916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.766275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.766562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.766886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.767205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.767521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.767854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.768168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.768483 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.768798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.769133 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.769452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.769774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.770088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.770403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.770723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.771552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.771882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.772384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.772701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.773035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.773390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.773742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.774059 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.774406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.774744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.775063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.775377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.775691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 01:23:12.775936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 01:23:12.823769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO dbcounter [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Registered counter for database nova_api Oct 27 01:23:12.838965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO dbcounter [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Registered counter for database nova_api Oct 27 01:23:12.844659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_db.sqlalchemy.engines [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.851593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writer thread running {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:12.859675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_db.sqlalchemy.engines [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.867674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writer thread running {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:12.909572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.context [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79e0fc89-c477-4f65-9016-7985d4fd2534(cell1) {{(pid=118905) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:23:12.914249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:23:12.914670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:23:12.916269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:23:12.917008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:23:12.917483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:23:12.919506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:23:12.921549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO dbcounter [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Registered counter for database nova_cell0 Oct 27 01:23:12.925796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO dbcounter [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Registered counter for database nova_cell1 Oct 27 01:23:12.927734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.context [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),79e0fc89-c477-4f65-9016-7985d4fd2534(cell1) {{(pid=118906) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 01:23:12.932472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:23:12.933545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:23:12.934579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_db.sqlalchemy.engines [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.934703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:23:12.935452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:23:12.935903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:23:12.937997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:23:12.939141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_db.sqlalchemy.engines [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.940839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO dbcounter [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Registered counter for database nova_cell0 Oct 27 01:23:12.942258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writer thread running {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:12.945625 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO dbcounter [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Registered counter for database nova_cell1 Oct 27 01:23:12.952958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_db.sqlalchemy.engines [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.955298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_db.sqlalchemy.engines [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:12.963221 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writer thread running {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:12.964532 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writer thread running {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:13.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writer thread running {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:13.097093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO dbcounter [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Registered counter for database nova_cell0 Oct 27 01:23:13.105516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_db.sqlalchemy.engines [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:13.110520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writer thread running {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:13.114971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO dbcounter [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Registered counter for database nova_cell0 Oct 27 01:23:13.121790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_db.sqlalchemy.engines [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 01:23:13.126402 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writer thread running {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 01:23:13.437955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: WARNING keystonemiddleware.auth_token [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:23:13.446198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: WARNING keystonemiddleware.auth_token [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:23:13.462324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: WARNING keystonemiddleware.auth_token [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:23:13.469712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: WARNING keystonemiddleware.auth_token [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:23:13.798530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: WARNING keystonemiddleware.auth_token [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:23:13.805455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: WARNING keystonemiddleware.auth_token [None req-b676ab8d-ad8b-470b-8861-4de9edb41cf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:23:13.811686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c16956d9c0 pid: 118905 (default app) Oct 27 01:23:13.822777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: WARNING keystonemiddleware.auth_token [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 01:23:13.828811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: WARNING keystonemiddleware.auth_token [None req-a470fc54-d7dd-4960-ab51-33b4fd365747 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 01:23:13.834727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c16956d9c0 pid: 118906 (default app) Oct 27 01:23:49.449358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:49.450442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:49.451279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:49.452401 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:51.118937 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5a9ff28a-2046-4b4a-b27a-ba9cc810e406 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Action: 'create', calling method: .version_select at 0x7f6c13fa6ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1766922204"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:52.768777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5a9ff28a-2046-4b4a-b27a-ba9cc810e406 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.324342 Oct 27 01:23:52.770510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Oct 27 01:23:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3328 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 01:23:52.788783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:52.790903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:52.794804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:52.796538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:23:53.096473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-735c55e2-6e2f-4561-ae41-0b39003261a8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13f9fc10>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:54.105835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ef6a2a39-db58-461c-82c0-3a62becdbd8c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13e2ed30>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:54.164116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-735c55e2-6e2f-4561-ae41-0b39003261a8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 200 len: 346 microversion: 2.1 time: 1.381268 Oct 27 01:23:54.164955 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:23:52 2022] GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 346 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:54.179820 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5a8265a7-17b8-4120-b56e-c7dccf5bcc27 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Action: 'create', calling method: .version_select at 0x7f6c13e66ca0>, body: {"snapshot": {"volume_id": "79ea2c47-0151-47bb-8f92-9cd3d9a11b1b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1214087403"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:23:54.261549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ef6a2a39-db58-461c-82c0-3a62becdbd8c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9ddb0a6c-e41b-425c-9d56-8ac74e3cce90" status: 200 len: 351 microversion: 2.1 time: 0.160465 Oct 27 01:23:54.262428 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:23:54 2022] GET /compute/v2.1/os-volumes/9ddb0a6c-e41b-425c-9d56-8ac74e3cce90 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:54.838044 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5a8265a7-17b8-4120-b56e-c7dccf5bcc27 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.663943 Oct 27 01:23:54.838881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 2/4] 10.222.0.42 () {60 vars in 1162 bytes} [Thu Oct 27 01:23:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:54.850719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-29a6318f-3eb6-4fcc-833c-50f8d5588d6d tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dc24c0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:55.242494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-29a6318f-3eb6-4fcc-833c-50f8d5588d6d tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.396666 Oct 27 01:23:55.249625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:54 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:55.254649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3189150c-a11f-44e4-b9c6-b144a4cb7cc7 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e29b80>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:55.349361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3189150c-a11f-44e4-b9c6-b144a4cb7cc7 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.098729 Oct 27 01:23:55.356556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 01:23:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:23:55.368702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-30b88ec2-ba3e-41a0-bfda-ea376318a915 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dc2c10>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:55.430222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-30b88ec2-ba3e-41a0-bfda-ea376318a915 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.072093 Oct 27 01:23:55.431369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:55 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:56.443377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3f71bf20-374b-4ce8-83ed-2b3d6d026b77 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e26f70>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:56.531907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3f71bf20-374b-4ce8-83ed-2b3d6d026b77 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.092360 Oct 27 01:23:56.537926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:56 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:57.545567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d7abb02a-08c3-4647-a3e2-78c406ff2cda tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dc2b80>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:57.614017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d7abb02a-08c3-4647-a3e2-78c406ff2cda tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.071107 Oct 27 01:23:57.614982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:57 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:58.627319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-25645637-e1c6-415d-b3ed-76cb15e2bc45 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e26a60>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:58.708284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-25645637-e1c6-415d-b3ed-76cb15e2bc45 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.084910 Oct 27 01:23:58.719869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:58 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:23:59.731969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2eeb5481-965e-4f1c-9960-5a0bd1c30c46 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dc2430>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:23:59.794214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2eeb5481-965e-4f1c-9960-5a0bd1c30c46 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.070446 Oct 27 01:23:59.802352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:23:59 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:00.808694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-70792a85-45a6-476d-b817-ef21f01256cc tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e263a0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:00.875431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-70792a85-45a6-476d-b817-ef21f01256cc tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.071708 Oct 27 01:24:00.876623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:24:00 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:01.889314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-da56c0c8-7646-458c-a380-d291a7d8d6e5 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e2edc0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:01.969751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-da56c0c8-7646-458c-a380-d291a7d8d6e5 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 288 microversion: 2.1 time: 0.084963 Oct 27 01:24:01.970485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:24:01 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:01.984904 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-327ab78b-0464-4fd9-90fc-d63a6df34691 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e29a60>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.141805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-327ab78b-0464-4fd9-90fc-d63a6df34691 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 202 len: 0 microversion: 2.1 time: 0.162173 Oct 27 01:24:02.142536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Oct 27 01:24:01 2022] DELETE /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:02.151240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5b1e55ba-e755-4ccc-b2f1-173644ca7efd tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dcc3a0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.212506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5b1e55ba-e755-4ccc-b2f1-173644ca7efd tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 200 len: 287 microversion: 2.1 time: 0.065122 Oct 27 01:24:02.213101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:24:02 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:02.806761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3e0eda7b-bcaa-4aa4-8edd-9daf3fc2d01c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13e29b80>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:02.955336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3e0eda7b-bcaa-4aa4-8edd-9daf3fc2d01c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/af4e8a44-9905-4bfc-b14c-3c5dec31108c" status: 200 len: 350 microversion: 2.1 time: 0.152923 Oct 27 01:24:02.956150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:02 2022] GET /compute/v2.1/os-volumes/af4e8a44-9905-4bfc-b14c-3c5dec31108c => generated 350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:03.229201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-26b128ba-69ef-4453-9f7d-9e098f673da3 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e2ed30>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:03.643120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-26b128ba-69ef-4453-9f7d-9e098f673da3 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] HTTP exception thrown: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-26b128ba-69ef-4453-9f7d-9e098f673da3 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Request method failure captured: Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 HTTP/1.1 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd2lE8GBJKHZ-9S4pdlxR4Ix9WIOE3H3oyKYRtXYqZ6GMO23GhbJ9vRiO4NRBlGsAWeN6ZUaGp4DT7Fu6qcSGQ0vkM2ij1SMrFTu0hdHkIoeIwV2V7fRxNtE87WgdiysvS8_hgFGP8yQ9Jq00Z7KxqvYuR9jh3EeGCTADODiqeuVQdo Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:03.653119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1de72905e70a4b7ab0bc68459daac163", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 931e14007f454ec9be4b44c39b3a9e22 Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11'} Oct 27 01:24:03.654482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. (HTTP 404) (Request-ID: req-c2ccbbde-a1ce-428b-abd1-91393471e185) Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.655508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:03.656638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 01:24:03.658996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. Oct 27 01:24:03.662326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:03.665646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-26b128ba-69ef-4453-9f7d-9e098f673da3 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Returning 404 to user: Snapshot e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:03.666809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-26b128ba-69ef-4453-9f7d-9e098f673da3 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11" status: 404 len: 111 microversion: 2.1 time: 0.445183 Oct 27 01:24:03.669458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:24:03 2022] GET /compute/v2.1/os-snapshots/e8f8c136-9fd8-46e2-ab0b-6f63ab0c4a11 => generated 111 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:03.680258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-86bb7b73-31ef-4afb-8a78-5a97fd884597 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13e26310>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:03.903851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-86bb7b73-31ef-4afb-8a78-5a97fd884597 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 202 len: 0 microversion: 2.1 time: 0.231198 Oct 27 01:24:03.904948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:24:03 2022] DELETE /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:24:03.919467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3bd86306-ee66-40e2-905b-78fe8521ca6c tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c147ad4c0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:04.050183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3bd86306-ee66-40e2-905b-78fe8521ca6c tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 200 len: 345 microversion: 2.1 time: 0.141074 Oct 27 01:24:04.051372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 10/19] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:03 2022] GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:04.955138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ac780351-7e36-42a8-99f6-71302dfe07e8 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13dcc820>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.005948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1887128938", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "networks": [{"uuid": "a64b63af-183f-41f2-aa9d-31ed91fe4c62"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:05.141649 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ac780351-7e36-42a8-99f6-71302dfe07e8 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b487f905-6fa2-4637-b088-74940763a284" status: 200 len: 350 microversion: 2.1 time: 0.192288 Oct 27 01:24:05.142226 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:04 2022] GET /compute/v2.1/os-volumes/b487f905-6fa2-4637-b088-74940763a284 => generated 350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:05.155331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ca83e8ba-55aa-4b40-841d-1cd85c5f45fc tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13dccf70>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.287537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ca83e8ba-55aa-4b40-841d-1cd85c5f45fc tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 200 len: 345 microversion: 2.1 time: 0.144088 Oct 27 01:24:05.289735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 12/21] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:05 2022] GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:05.296499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0d4b5e03-39cb-4d4e-9fed-fcfb1ff6e416 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13dc35e0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:05.393571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] validate_networks() for [('a64b63af-183f-41f2-aa9d-31ed91fe4c62', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:24:05.616915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0d4b5e03-39cb-4d4e-9fed-fcfb1ff6e416 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.321848 Oct 27 01:24:05.617860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 01:24:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:05.634430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6c1f98bb-b599-4893-b976-b4960e0f3655 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13dc3790>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:06.041072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6c1f98bb-b599-4893-b976-b4960e0f3655 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.412102 Oct 27 01:24:06.050292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 14/23] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Oct 27 01:24:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:06.312323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-29faa4cd-3245-4e41-9feb-2c7ed77f180d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: .version_select at 0x7f6c13e2ec10>, body: {"keypair": {"name": "tempest-keypair-1919379818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrCTDGXKNyAYl5W4zHCS3u2w9r0r3NERrCGBAKsVEe+r+2AuBnBV7hGSeE2S9M6q7XUN0XC3dccXmoOnywEc3sEsnML4muqaGPwi4cJGegCdrUJtf51w05AEqwQgVJGsw=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:06.440312 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-29faa4cd-3245-4e41-9feb-2c7ed77f180d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:06.458865 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-29faa4cd-3245-4e41-9feb-2c7ed77f180d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:06.549848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-29faa4cd-3245-4e41-9feb-2c7ed77f180d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.500324 Oct 27 01:24:06.554265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 15/24] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:24:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:06.571399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-29363205-2605-4909-a5ea-32a4ebb59726 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13cf4ca0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:06.772955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-29363205-2605-4909-a5ea-32a4ebb59726 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.217241 Oct 27 01:24:06.775221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 16/25] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Oct 27 01:24:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:06.780622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b3028da1-f6cf-44fb-a8c5-7c8117c7fa38 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13d30670>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:06.844187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-b3028da1-f6cf-44fb-a8c5-7c8117c7fa38 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] HTTP exception thrown: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b3028da1-f6cf-44fb-a8c5-7c8117c7fa38 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Request method failure captured: Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b HTTP/1.1 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd2lE8GBJKHZ-9S4pdlxR4Ix9WIOE3H3oyKYRtXYqZ6GMO23GhbJ9vRiO4NRBlGsAWeN6ZUaGp4DT7Fu6qcSGQ0vkM2ij1SMrFTu0hdHkIoeIwV2V7fRxNtE87WgdiysvS8_hgFGP8yQ9Jq00Z7KxqvYuR9jh3EeGCTADODiqeuVQdo Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:06.847040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1de72905e70a4b7ab0bc68459daac163", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 931e14007f454ec9be4b44c39b3a9e22 Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '79ea2c47-0151-47bb-8f92-9cd3d9a11b1b'} Oct 27 01:24:06.849253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. (HTTP 404) (Request-ID: req-765e8c46-0190-4475-bc69-24cd8d092463) Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:06.850046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:06.862862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 01:24:06.866332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b3028da1-f6cf-44fb-a8c5-7c8117c7fa38 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Returning 404 to user: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b3028da1-f6cf-44fb-a8c5-7c8117c7fa38 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 404 len: 109 microversion: 2.1 time: 0.072819 Oct 27 01:24:06.869184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 17/26] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:06 2022] GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:07.000761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2046761193", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:07.194826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:07.195413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:07.196216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:07.196623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:07.197134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:07.214011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] validate_networks() for [('03467824-1af5-46b4-9775-45b8ed4ca0b6', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:24:07.224975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:07.225490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:07.225924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:07.226645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:07.227091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:07.227535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:07.304001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Getting quotas for project c72a2266373f44749fa0d3bbd3bb68cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:07.316859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Getting quotas for user 68909cf0c5bf4875927b30d9a6ce8cd9 and project c72a2266373f44749fa0d3bbd3bb68cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:07.340170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:24:07.355510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:24:07.507033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1e1c9260-1c5e-4c50-9847-54b146bd0759 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.062607 Oct 27 01:24:07.510095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 10/27] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:07.522337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fd7278de-bb78-4821-a0d7-b36b2c56b2a9 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c134c28b0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:07.871207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fd7278de-bb78-4821-a0d7-b36b2c56b2a9 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.359606 Oct 27 01:24:07.872146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Oct 27 01:24:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:07.884740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-24450a7e-ebcc-4f87-ae68-2f72eb0427ec tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c134d8ca0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:07.940984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-24450a7e-ebcc-4f87-ae68-2f72eb0427ec tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] HTTP exception thrown: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-24450a7e-ebcc-4f87-ae68-2f72eb0427ec tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Request method failure captured: Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b HTTP/1.1 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd2lE8GBJKHZ-9S4pdlxR4Ix9WIOE3H3oyKYRtXYqZ6GMO23GhbJ9vRiO4NRBlGsAWeN6ZUaGp4DT7Fu6qcSGQ0vkM2ij1SMrFTu0hdHkIoeIwV2V7fRxNtE87WgdiysvS8_hgFGP8yQ9Jq00Z7KxqvYuR9jh3EeGCTADODiqeuVQdo Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:24:07.947946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1de72905e70a4b7ab0bc68459daac163", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 931e14007f454ec9be4b44c39b3a9e22 Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '79ea2c47-0151-47bb-8f92-9cd3d9a11b1b'} Oct 27 01:24:07.948946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. (HTTP 404) (Request-ID: req-0c36962d-c950-42ce-ae54-2e143840d1ea) Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:07.949607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:07.950510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 01:24:07.953096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-24450a7e-ebcc-4f87-ae68-2f72eb0427ec tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Returning 404 to user: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:07.954588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-24450a7e-ebcc-4f87-ae68-2f72eb0427ec tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 404 len: 109 microversion: 2.1 time: 0.077300 Oct 27 01:24:07.956336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 12/29] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:24:07 2022] DELETE /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:07.961824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b1630cee-a06d-4f74-a413-badb437735b1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:07.963815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b1630cee-a06d-4f74-a413-badb437735b1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:08.203776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b1630cee-a06d-4f74-a413-badb437735b1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:08.226687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b1630cee-a06d-4f74-a413-badb437735b1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1215 microversion: 2.1 time: 0.269680 Oct 27 01:24:08.231479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 13/30] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:07 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:08.370222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0e8c9931-a52a-48ff-8724-c049142e127d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: .version_select at 0x7f6c13453670>, body: {"keypair": {"name": "tempest-keypair-80468465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmuSV6J11LbuSYbDHKp16K6CCzg01f8hW9YL1qrtfOSYFTidgoKfQUEPacySUK5YkGXwMC7AHE2t7VF2nar6rCJv4p9QkiyZQTFbG9IzMKyLjnGcQ59E/T+i1AaCTYz4Q=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:08.423319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-0e8c9931-a52a-48ff-8724-c049142e127d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:08.430161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-0e8c9931-a52a-48ff-8724-c049142e127d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for user cca36a277e3643a498b27e3c5d5e14f4 and project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:08.487456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:08.488136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:08.489372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:08.490067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:08.491652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:08.496316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0e8c9931-a52a-48ff-8724-c049142e127d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.263503 Oct 27 01:24:08.499723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 14/31] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:24:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:08.509872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:08.510513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:08.510959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:08.511733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:08.512192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:08.512617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:08.519451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0110c5cd-1207-4232-96ac-54739abcb292 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c134d7ca0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.554085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:08.559714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for user d311fc1f82124819b509f766fa432e2c and project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:08.574392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:24:08.577853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:24:08.730423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-74d1b410-9e67-4017-a332-34ee99d63c54 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.877024 Oct 27 01:24:08.732993 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 18/32] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:24:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:08.751459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-641e6397-5260-4866-ae39-0a33dd6b6bc8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Calling method '.version_select at 0x7f6c13c5e820>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.774045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0110c5cd-1207-4232-96ac-54739abcb292 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.272797 Oct 27 01:24:08.775134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 15/33] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Oct 27 01:24:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:08.780805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bf8a4b62-186c-434b-9ad6-88380d7fb794 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:08.785972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bf8a4b62-186c-434b-9ad6-88380d7fb794 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:08.881832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-641e6397-5260-4866-ae39-0a33dd6b6bc8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] HTTP exception thrown: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-641e6397-5260-4866-ae39-0a33dd6b6bc8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Request method failure captured: Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b HTTP/1.1 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd2lE8GBJKHZ-9S4pdlxR4Ix9WIOE3H3oyKYRtXYqZ6GMO23GhbJ9vRiO4NRBlGsAWeN6ZUaGp4DT7Fu6qcSGQ0vkM2ij1SMrFTu0hdHkIoeIwV2V7fRxNtE87WgdiysvS8_hgFGP8yQ9Jq00Z7KxqvYuR9jh3EeGCTADODiqeuVQdo Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:08.884184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1de72905e70a4b7ab0bc68459daac163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1de72905e70a4b7ab0bc68459daac163", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1de72905e70a4b7ab0bc68459daac163 Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-829533206 Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 931e14007f454ec9be4b44c39b3a9e22 Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesSnapshotsTestJSON-829533206-project Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '79ea2c47-0151-47bb-8f92-9cd3d9a11b1b'} Oct 27 01:24:08.885252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. (HTTP 404) (Request-ID: req-af43dfc9-04f5-4860-9cf4-943027fe0c09) Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:08.885971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:08.887364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 01:24:08.888220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-641e6397-5260-4866-ae39-0a33dd6b6bc8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] Returning 404 to user: Volume 79ea2c47-0151-47bb-8f92-9cd3d9a11b1b could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-641e6397-5260-4866-ae39-0a33dd6b6bc8 tempest-VolumesSnapshotsTestJSON-829533206 tempest-VolumesSnapshotsTestJSON-829533206-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b" status: 404 len: 109 microversion: 2.1 time: 0.140854 Oct 27 01:24:08.890301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 19/34] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:08 2022] GET /compute/v2.1/os-volumes/79ea2c47-0151-47bb-8f92-9cd3d9a11b1b => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:08.899652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6321b395-7a58-490d-91e2-6b8fe07b971a tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c133f24c0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:09.011421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bf8a4b62-186c-434b-9ad6-88380d7fb794 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:09.018468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bf8a4b62-186c-434b-9ad6-88380d7fb794 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1222 microversion: 2.1 time: 0.242028 Oct 27 01:24:09.023391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 16/35] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:08 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:09.145126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-211526076", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:09.195335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6321b395-7a58-490d-91e2-6b8fe07b971a tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.308128 Oct 27 01:24:09.196174 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 01:24:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:09.216275 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fca6a95d-523d-4ee0-8a97-11f4bb6606a9 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13d30ee0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:09.281567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] validate_networks() for [('03467824-1af5-46b4-9775-45b8ed4ca0b6', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:24:09.445761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fca6a95d-523d-4ee0-8a97-11f4bb6606a9 tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.235229 Oct 27 01:24:09.446625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 21/37] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Oct 27 01:24:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:24:09.451377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6f29c303-d9d0-4596-a02a-f8aa495a73ba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:09.452164 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6f29c303-d9d0-4596-a02a-f8aa495a73ba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:09.862188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6f29c303-d9d0-4596-a02a-f8aa495a73ba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:09.891500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6f29c303-d9d0-4596-a02a-f8aa495a73ba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1215 microversion: 2.1 time: 0.443365 Oct 27 01:24:09.892850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 22/38] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:09 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1215 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:09.899864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-adbeab65-ef20-47f2-96c7-75a018e0646c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] Calling method '.version_select at 0x7f6c13d1bb80>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:10.168315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-adbeab65-ef20-47f2-96c7-75a018e0646c tempest-VolumesTestJSON-819448063 tempest-VolumesTestJSON-819448063-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.273406 Oct 27 01:24:10.168835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Oct 27 01:24:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:10.523689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:10.524286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:10.524707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:10.527825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:10.528302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:10.556892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:10.558560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:10.559537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:10.560631 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:10.561521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:10.562504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:10.604178 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:10.609646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for user d311fc1f82124819b509f766fa432e2c and project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:10.634238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:24:10.637533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:24:10.780775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-daa6e6b2-410f-46ef-80ce-bdf259a35044 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.638973 Oct 27 01:24:10.792828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 17/40] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:24:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:10.802382 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7275e5af-1291-47a9-9a03-91dee253f39c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:10.805585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7275e5af-1291-47a9-9a03-91dee253f39c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:10.923772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:10.924576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:10.939056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:10.939559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:10.939998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:10.940712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:10.957761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:10.957761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:11.016485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7275e5af-1291-47a9-9a03-91dee253f39c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:11.029720 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7275e5af-1291-47a9-9a03-91dee253f39c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1221 microversion: 2.1 time: 0.237505 Oct 27 01:24:11.031137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 24/41] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:10 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:11.760382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:11.815026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-726c646e-d20c-4469-a53c-0d71ebed1b8b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1267 microversion: 2.1 time: 0.891235 Oct 27 01:24:11.838280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:10 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1267 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:12.061961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0d250f06-e65c-4c54-9def-028e3eab052c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:12.063639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0d250f06-e65c-4c54-9def-028e3eab052c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:12.290900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0d250f06-e65c-4c54-9def-028e3eab052c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:12.307570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0d250f06-e65c-4c54-9def-028e3eab052c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1221 microversion: 2.1 time: 0.250849 Oct 27 01:24:12.311598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:12 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:12.847302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:12.849168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:12.857855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:12.858651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:12.859385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:12.860292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:12.860947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:12.863626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:13.320574 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:13.331512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1764258304", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ba9997c-2f90-403d-993a-09c134c8fd7e"}], "security_groups": [{"name": "tempest-securitygroup--1495928852"}], "key_name": "tempest-keypair-1919379818", "user_data": "}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:13.334197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1e01b795-bc12-42f8-8ffe-f9502406979b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1273 microversion: 2.1 time: 0.491410 Oct 27 01:24:13.357325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 19/44] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:12 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1273 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:13.374086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:13.379114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:13.392952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:13.394097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:13.394844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:13.395922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:13.396948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:13.398204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:13.719376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:13.735876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ec74e5e3-36a7-4646-afee-905f3a602f48 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1273 microversion: 2.1 time: 0.372328 Oct 27 01:24:13.736961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 20/45] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:13 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:14.288748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] validate_networks() for [('4ba9997c-2f90-403d-993a-09c134c8fd7e', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:24:14.361518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:14.363492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:14.373121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:14.378691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:14.379492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:14.381456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:14.384107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:14.384742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:14.759820 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:14.776821 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e880eab9-3d67-424b-96ba-bafcf185e4b2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1273 microversion: 2.1 time: 0.419537 Oct 27 01:24:14.786368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 21/46] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:14 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1273 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:14.799465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:14.802025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:14.832006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:14.833653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:14.835733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:14.836825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:14.838697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:14.842224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:16.082189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:16.103500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cecef1a9-a7b2-4a47-8d93-aa4b75a2c83b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1279 microversion: 2.1 time: 1.314491 Oct 27 01:24:16.104289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:14 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1279 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:16.120553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:16.121906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:16.135677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:16.138328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:16.140794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:16.144369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:16.145183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:16.145808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:17.185115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:17.204406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-51fe3639-1220-479b-a8c6-ee4ea598d9d4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 1.091234 Oct 27 01:24:17.211131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:16 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:17.228290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:17.231030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:17.257486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:17.260146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:17.260808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:17.264209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:17.268184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:17.269020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:17.508567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:17.523261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-62b12783-7d19-4728-91c9-7fb3ec322f8c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1279 microversion: 2.1 time: 0.305027 Oct 27 01:24:17.526811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 24/49] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:17 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:17.922976 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:17.923483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:17.923891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:17.924435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:17.925141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:17.951203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:17.955348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:17.955990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:17.956855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:17.963393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:17.972732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:18.031754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:18.043530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:18.114829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:24:18.119155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:24:18.214578 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-821315855", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6bca71c-aea1-476d-8633-0cf730614609"}], "security_groups": [{"name": "tempest-securitygroup--1388772465"}], "key_name": "tempest-keypair-80468465", "user_data": "}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:18.393264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e1bfcfd3-7f62-41fb-8475-8ed58b4a7eac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.072053 Oct 27 01:24:18.405097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:24:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 5084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:24:18.421381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:18.423300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:18.447595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:18.448108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:18.477717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:18.489271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:18.493468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:18.498572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:19.017646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] validate_networks() for [('e6bca71c-aea1-476d-8633-0cf730614609', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:24:20.031359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:24:20.031910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:24:20.033437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:24:20.033437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:24:20.034043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:24:20.075871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.076373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.076815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:20.084803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.089763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.091665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:20.123964 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:20.166270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5bb9e4c5-4b29-4a04-b707-daf934691b07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 1.759746 Oct 27 01:24:20.166866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 27/51] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:18 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:20.172930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:24:20.189264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for user cca36a277e3643a498b27e3c5d5e14f4 and project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:24:20.206026 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:20.207291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:20.245959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.248250 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:24:20.249578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.250692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:24:20.252194 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:20.254079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.267227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.270218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:20.415926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-efd6385a-3f57-4d32-b466-b59bce175468 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.213554 Oct 27 01:24:20.424522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 25/52] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:24:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:24:20.436489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:20.437997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:20.446000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.447332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.448115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:20.449722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:20.450339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:20.450897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:21.758235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:21.772188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-de952402-454f-403c-95bf-39b7be8b0431 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1238 microversion: 2.1 time: 1.573485 Oct 27 01:24:21.797415 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:20 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1238 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:21.821639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:21.822261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:21.844628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:21.845311 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:21.853847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:21.854635 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:21.855123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:21.855568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:22.140226 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:22.162668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ca668795-d9c6-497d-801c-9a5ef39ec4a1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1239 microversion: 2.1 time: 0.335611 Oct 27 01:24:22.176841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:21 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1239 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:22.187521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:22.201182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ddc8d244-0cfd-4547-a186-f0c0759b86f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 1.774522 Oct 27 01:24:22.201854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:22.204161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:20 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:22.205637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:22.230754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:22.241821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:22.243097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:22.244568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:22.245042 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:22.245509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:22.999643 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f69cc4c9-13fe-46d9-bb51-463b977f2398 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Action: 'create', calling method: .version_select at 0x7f6c133909d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-883408868", "metadata": {"Type": "work"}}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f69cc4c9-13fe-46d9-bb51-463b977f2398 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 121 Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:24:23.005183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-883408868", "metadata": {"Type": "work"}}} Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: Oct 27 01:24:23.006265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-883408868', 'metadata': {'Type': 'work'}}}} Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise error Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.006960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 01:24:23.008074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 01:24:23.009013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 01:24:23.009013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.009013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f69cc4c9-13fe-46d9-bb51-463b977f2398 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.014771 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f69cc4c9-13fe-46d9-bb51-463b977f2398 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.809207 Oct 27 01:24:23.020208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 27/56] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 01:24:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 815 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:24:23.039525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.047208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:23.052882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:23.072856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4be0c2d2-904d-48b9-8294-81d5780bb74f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.886697 Oct 27 01:24:23.074162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.075356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.076678 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 30/57] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:22 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:23.077441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.080911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.083794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.090233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.117228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-11e3747d-6e05-48e0-a02f-4d679614128c tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Action: 'create', calling method: .version_select at 0x7f6c132f7550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-192300620", "metadata": {"Type": "work"}}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-11e3747d-6e05-48e0-a02f-4d679614128c tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 119 Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:23.132870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-192300620", "metadata": {"Type": "work"}}} Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:23.134046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-192300620', 'metadata': {'Type': 'work'}}}} Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise error Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi '0' Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.134809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 01:24:23.136131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 01:24:23.137096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 01:24:23.137096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.137096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-11e3747d-6e05-48e0-a02f-4d679614128c tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.137096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-11e3747d-6e05-48e0-a02f-4d679614128c tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040942 Oct 27 01:24:23.143369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 31/58] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 01:24:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:24:23.157536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0231c415-1171-45ba-a011-1d118f433cdd tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Action: 'create', calling method: .version_select at 0x7f6c13369a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1415819137", "metadata": {"Type": "work"}}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0231c415-1171-45ba-a011-1d118f433cdd tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 119 Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:23.165878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1415819137", "metadata": {"Type": "work"}}} Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:23.167310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1415819137', 'metadata': {'Type': 'work'}}}} Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise error Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi '' Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.168127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 01:24:23.169603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 01:24:23.171626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 01:24:23.171626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.178894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0231c415-1171-45ba-a011-1d118f433cdd tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.180257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0231c415-1171-45ba-a011-1d118f433cdd tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035068 Oct 27 01:24:23.189929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 32/59] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 01:24:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:24:23.207549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f71997d1-e5d8-4aa5-868f-bdc72a231fb0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Calling method '.version_select at 0x7f6c13346310>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.297916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-f71997d1-e5d8-4aa5-868f-bdc72a231fb0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] HTTP exception thrown: Volume tempest-invalid-1097959756 could not be found. Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f71997d1-e5d8-4aa5-868f-bdc72a231fb0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1097959756 HTTP/1.1 Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:23.300868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Volume tempest-invalid-1097959756 could not be found. Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'tempest-invalid-1097959756'} Oct 27 01:24:23.303968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1097959756 could not be found. (HTTP 404) (Request-ID: req-73b81720-68bd-43e4-a1fe-b22ba71df2e0) Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.304942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:23.306234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1097959756 could not be found. Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:23.307138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1097959756 could not be found. Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1097959756 could not be found. Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f71997d1-e5d8-4aa5-868f-bdc72a231fb0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 404 to user: Volume tempest-invalid-1097959756 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f71997d1-e5d8-4aa5-868f-bdc72a231fb0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1097959756" status: 404 len: 99 microversion: 2.1 time: 0.108485 Oct 27 01:24:23.308125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 33/60] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 01:24:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1097959756 => generated 99 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 01:24:23.315017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.316812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:23.327763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.328513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.328958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.329760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.330223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.330655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.437763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:23.458407 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-89254664-b789-415b-b54b-869b04fbb075 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1300 microversion: 2.1 time: 0.435732 Oct 27 01:24:23.463106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 28/61] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:23 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1300 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:23.490498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.495147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:23.511648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.512223 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.512696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.515909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:23.517697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:23.521395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:23.566658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:23.585818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-db09832a-bb36-476e-a390-ab4d721bc6a3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1287 microversion: 2.1 time: 0.276156 Oct 27 01:24:23.588727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 34/62] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:23 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1287 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:23.608052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5ec1cb88-80cf-40ab-9189-f9c7894bb21e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015643 Oct 27 01:24:23.614332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 35/63] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Oct 27 01:24:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 01:24:23.632512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-757e74ef-c287-4705-9bb8-51bbe62412d0 tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013077 Oct 27 01:24:23.639789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 36/64] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Oct 27 01:24:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 01:24:23.664062 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7b83f80b-f831-4156-b29b-d5fb4073af0e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Calling method '.version_select at 0x7f6c13346d30>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.772607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-7b83f80b-f831-4156-b29b-d5fb4073af0e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] HTTP exception thrown: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7b83f80b-f831-4156-b29b-d5fb4073af0e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/os-volumes/9057bc4d-97bd-4cc7-a7ae-88df656707e5 HTTP/1.1 Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:23.774631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '9057bc4d-97bd-4cc7-a7ae-88df656707e5'} Oct 27 01:24:23.775702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. (HTTP 404) (Request-ID: req-3b68969a-6cfb-476b-a29e-ce93be8d0f70) Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.776526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 01:24:23.778119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 01:24:23.779022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7b83f80b-f831-4156-b29b-d5fb4073af0e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 404 to user: Volume 9057bc4d-97bd-4cc7-a7ae-88df656707e5 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7b83f80b-f831-4156-b29b-d5fb4073af0e tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9057bc4d-97bd-4cc7-a7ae-88df656707e5" status: 404 len: 109 microversion: 2.1 time: 0.124694 Oct 27 01:24:23.779932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 37/65] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:24:23 2022] DELETE /compute/v2.1/os-volumes/9057bc4d-97bd-4cc7-a7ae-88df656707e5 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:24:23.792751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ea561113-34d8-4f81-b8af-982024be5f6f tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Calling method '.version_select at 0x7f6c132f7550>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:23.870412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-ea561113-34d8-4f81-b8af-982024be5f6f tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] HTTP exception thrown: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ea561113-34d8-4f81-b8af-982024be5f6f tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Request method failure captured: Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/os-volumes/aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 HTTP/1.1 Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd3FiCTLRQrObRFS3YZu7wLXfU4yQJK2EtcCAMFkydT-1npQXuL9I7hSCkp57PlopMgYAYUThn6dGE-6yurlIt-NR1yTgA5PQ9u1dFMhSi52f1j-gWSR2VKaWM6bHEOvmvPoEexCJFriJKGutxYEzPpqVWnoKKCgCmRgxFdNIEoYIyg Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:24:23.873165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a7e7557398ad411a92d3ec3f315b97bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a7e7557398ad411a92d3ec3f315b97bd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a7e7557398ad411a92d3ec3f315b97bd Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesNegativeTest-373950922 Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1c471d2db8994adeac8d2cfe82801e4a Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesNegativeTest-373950922-project Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1'} Oct 27 01:24:23.874634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. (HTTP 404) (Request-ID: req-33ddf9a9-19cd-47ce-bc78-5129e0826fc5) Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.875298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:24:23.876242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 01:24:23.877183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ea561113-34d8-4f81-b8af-982024be5f6f tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] Returning 404 to user: Volume aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ea561113-34d8-4f81-b8af-982024be5f6f tempest-VolumesNegativeTest-373950922 tempest-VolumesNegativeTest-373950922-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1" status: 404 len: 109 microversion: 2.1 time: 0.092046 Oct 27 01:24:23.878208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 38/66] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:24:23 2022] GET /compute/v2.1/os-volumes/aa9b4a4e-2ccb-4e0b-b699-5e3997bf92a1 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:24:24.105089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:24.105760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:24.115404 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:24.121701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:24.122168 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:24.122925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:24.123421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:24.123869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:24.743208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:24.755967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cf0521fd-6b72-4b17-9988-1176a3d134f2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 1.291132 Oct 27 01:24:24.773176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 29/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:23 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:24.790328 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:24.798179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b65519e6-c740-42eb-800c-3c72fec995d8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.697855 Oct 27 01:24:24.801382 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 39/68] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:24 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:24.817844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:24.819472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:24.834556 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:24.835309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:24.835898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:24.836762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:24.837405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:24.837981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:24.948129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:24.970365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4e7ac78c-f971-4754-9c0c-0f8ea22e0578 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1300 microversion: 2.1 time: 0.167714 Oct 27 01:24:24.971481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 40/69] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:24 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:24.989886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:24.990728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:25.001185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.002035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.002684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.004335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.010402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.011198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.187331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56da46ce-164d-41a9-96f0-1e23257f43f1", "tag": "d74997a4-8058-410c-9e78-4a15650df34e"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:25.204542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.205318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.206915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.231695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:25.237169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Creating event network-changed:d74997a4-8058-410c-9e78-4a15650df34e for instance 56da46ce-164d-41a9-96f0-1e23257f43f1 on hv-cinder-81558 Oct 27 01:24:25.238206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118906) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 01:24:25.238898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ce010ecb-eab4-4d9a-b84e-12ef9fedbb73 req-5feb5ebe-671b-4948-bacc-d7216d410060 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118906) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 01:24:25.239878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-af4d1510-aae2-4d47-9766-b7a81755d0af tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.266259 Oct 27 01:24:25.240103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.240562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.241106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.244741 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.244932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 41/70] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:24 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:25.246600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.247052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.283017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.compute.rpcapi [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 01:24:25.285222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118906) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 01:24:25.310940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c94fb16b-3e6b-4b6c-ae64-a9c47c3430f4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546081 Oct 27 01:24:25.314415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 30/71] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:25.367188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08e412b-ed93-474b-9f25-0c643550c84c", "tag": "03b4b398-12c2-4b2b-b9c0-441545a05f75"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:25.384494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.385309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.386100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.417450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Creating event network-changed:03b4b398-12c2-4b2b-b9c0-441545a05f75 for instance f08e412b-ed93-474b-9f25-0c643550c84c on hv-cinder-81558 Oct 27 01:24:25.418335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118905) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 01:24:25.418991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-cf101429-c094-41d4-85d1-0f8a64212de9 req-866c8898-2d56-4cc8-b064-2d0e324c98c9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118905) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 01:24:25.420311 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.421008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.421771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.422799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.423484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.424154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.436449 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.compute.rpcapi [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 01:24:25.437796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] Releasing lock "compute-rpcapi-router" {{(pid=118905) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 01:24:25.462123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d2db7a5c-4105-4a0a-b88b-af8a81b5e6ac None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215173 Oct 27 01:24:25.463479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 42/72] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:25.783465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:25.785498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:25.825390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.826263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.829203 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.835810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.836172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:25.836747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.837128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:25.837423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.857232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.858200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.858789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:25.859654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:25.860317 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:25.860914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:26.160479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:26.169589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a7b8e9bc-124b-41f8-9534-3db462b3138c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.341302 Oct 27 01:24:26.170185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 43/73] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:25 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:26.180127 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:26.192610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a4009040-557e-4419-b8e4-d51cdb2cd5aa tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.413639 Oct 27 01:24:26.192858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:26.193534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:26.202309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:26.204390 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:26.204836 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:26.205588 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:26.206036 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:26.210806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 31/74] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:25 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:26.211853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:26.271644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:26.272871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:26.280420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:26.281744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:26.282371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:26.283353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:26.283993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:26.284615 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:26.376944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:26.387714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b241f904-389d-48ec-8b43-2e672335a7d4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.120493 Oct 27 01:24:26.395877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 32/75] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:26 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:26.443043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:26.451125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-31b24ba5-a7db-443e-b33d-3aba1b355169 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.274201 Oct 27 01:24:26.452338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 44/76] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:26 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:27.195518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:27.196355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:27.202568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.203063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.203682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.204381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.204982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.205427 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.225083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:27.225699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:27.233139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.235395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.236668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.238724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.239906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.240916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.420857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:27.431816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-441130bf-f84a-46a7-922f-c2f0f67fe692 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.241094 Oct 27 01:24:27.432395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 33/77] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:27 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:27.437734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1923ce-640b-4bc6-b02b-722901af4b9f", "tag": "a826d83f-2f6e-4c48-b09b-56890b3a069f"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:27.454750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:27.455059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:27.456914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.457543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.458040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.475803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] Creating event network-changed:a826d83f-2f6e-4c48-b09b-56890b3a069f for instance fb1923ce-640b-4bc6-b02b-722901af4b9f on hv-cinder-81558 Oct 27 01:24:27.482025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-3e4bb39f-94b7-4711-be4f-5512653a0f7d req-59fe4276-9703-40b4-bcb6-045090d43e69 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047668 Oct 27 01:24:27.483630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 34/78] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:27.488210 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-55d767bc-cec0-4601-8443-d630785a586a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.266430 Oct 27 01:24:27.494293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:27.495219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:27.497217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 45/79] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:27 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:27.501681 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.502157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.502696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.504156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.504626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.505176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.510607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:27.511508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:27.518176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.518743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.519284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.519985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:27.520426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:27.520847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:27.591546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:27.601814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-64583069-5a81-4efd-b32c-f244fadca2e0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.110884 Oct 27 01:24:27.609782 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 35/80] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:27 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:27.691219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:27.701723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c613f1c5-72d7-4cf4-882e-24396fb9649e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.202454 Oct 27 01:24:27.702364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 46/81] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:27 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:28.469956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:28.470744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:28.480706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.481505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.482117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.483666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.484243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.484830 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.518287 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:28.520989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:28.521874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:28.528120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=22 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:28.530422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.531097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.531718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.533013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.535025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.535642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.808372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:28.819683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:28.832275 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-701d3771-2452-4482-98a1-29785c717f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.316703 Oct 27 01:24:28.832857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 47/82] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:28 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:28.833854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ca02cb46-5a27-465c-a978-0f5325353344 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.369565 Oct 27 01:24:28.834590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 36/83] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:28 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:28.852703 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:28.853613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:28.854215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:28.856085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:28.865389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.865878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.866307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.866999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.867570 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.869197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.869727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.870099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.870793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:28.871234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:28.871648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.876144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:28.995038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:29.011642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c4bad0a0-993a-4f5b-b68d-384e75271cca tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.175792 Oct 27 01:24:29.016464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 37/84] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:28 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:29.160832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:29.170498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-459b1116-485c-4bab-aad3-1fe54ab307b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.332421 Oct 27 01:24:29.171551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 48/85] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:28 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:29.860295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:29.862293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:29.864600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:29.865347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:29.871468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:29.874882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:29.887847 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:29.889881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:29.891153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:29.894382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:29.895141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:29.896419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:29.901108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:29.901648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:29.903845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:29.905929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:29.906566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:29.920774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=93 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:30.213019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:30.237267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0e7b2b68-1953-4cc0-81eb-13af08d7a241 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.368201 Oct 27 01:24:30.237935 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 38/86] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:29 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:30.258524 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:30.259170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:30.277099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:30.283216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=26 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:30.289502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:30.291313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:30.292533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:30.293420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:30.294063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:30.294587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:30.296385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-69a30e8c-4ba5-416c-a826-2802626c92f5 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.439381 Oct 27 01:24:30.299080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 49/87] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:29 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:30.318999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:30.319970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:30.329369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:30.332736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:30.333432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:30.334337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:30.336751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:30.337419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:30.444630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:30.460801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-110bab40-c815-4f71-af9e-c57e7527d7e4 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.220188 Oct 27 01:24:30.462771 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 39/88] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:30 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:30.729224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:30.742815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-03fbde5a-5ec9-406e-ae71-1f9092eb8586 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.441020 Oct 27 01:24:30.743737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 50/89] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:30 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:31.264200 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:31.264817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:31.271154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.271642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.272075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.272811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.276085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.276085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.324965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:31.326448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:31.333418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.333919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.334358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.335075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.335531 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.335958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.531925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:31.549327 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ab5b694c-829b-4f16-8035-81c2b6a8939f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.289326 Oct 27 01:24:31.550987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 40/90] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:31 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:31.563194 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:31.570795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:31.571683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:31.573461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5336ae04-93ac-4390-a746-cf44b2fb62cd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.252134 Oct 27 01:24:31.583601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 51/91] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:31 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:31.591040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.591535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.592510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.606158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.606909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.611417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.701678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:31.712073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0083261f-f97a-49c0-962b-327ebfda38ba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.159754 Oct 27 01:24:31.713001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 41/92] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:31 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:31.768100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:31.769826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:31.776473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.777131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.777730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.778740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:31.779096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:31.779597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:31.979101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:31.987940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-efec6161-b665-45e0-9de5-cb48cc416a39 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.224066 Oct 27 01:24:31.988902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 52/93] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:31 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:32.578186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:32.579457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:32.590894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:32.591550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:32.593227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:32.596041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:32.597276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:32.603158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:32.608442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:32.609960 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:32.625387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:32.626565 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:32.627537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:32.629962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:32.631053 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:32.632377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.500177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:33.505188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:33.512366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3311ce5b-dd47-4495-b374-99976289b0e9 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.906932 Oct 27 01:24:33.526460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 53/94] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:32 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:33.528351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eecf1458-824b-4ef1-8296-dd3c022e3b11 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.954600 Oct 27 01:24:33.537792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:33.538735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:33.546503 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:33.547256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:33.547803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.548580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:33.549605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:33.550377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.554268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 42/95] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:32 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:33.562565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:33.563901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:33.574911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:33.575457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:33.576046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.576739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:33.577947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:33.578568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.734633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:33.745487 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9f9dc0da-1da4-4462-9cab-fba24a9ac1e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1293 microversion: 2.1 time: 0.217171 Oct 27 01:24:33.746245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 54/96] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:33 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1293 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:33.763021 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0043e0-d539-46b1-bdd1-8adc22ef0d95", "tag": "9bbe4643-e570-4c73-9fd9-c977cef6c27c"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:33.775736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:33.776403 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:33.776970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:33.789776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] Creating event network-changed:9bbe4643-e570-4c73-9fd9-c977cef6c27c for instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 on hv-cinder-81558 Oct 27 01:24:33.795208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-6204913e-636e-4ae9-bf47-d1bca753f739 req-c7736d3d-f47a-4f64-8e01-f0c75ebe00a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042488 Oct 27 01:24:33.795764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 55/97] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:34.007605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:34.022401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ec818977-98dd-4303-9bc4-32fe32a80aaf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.466920 Oct 27 01:24:34.026615 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 43/98] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:33 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:34.541559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:34.542284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:34.555113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.555456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.556342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:34.556606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:34.557572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.558242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.558995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:34.560954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:34.572158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.572916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.573591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:34.574723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.575383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.576019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:34.929551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:34.934897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:34.957967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5de08ddd-4600-47d6-acf0-553f2796565c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.420783 Oct 27 01:24:34.958568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-71884934-3003-47b5-9d80-fa0c441484da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.405440 Oct 27 01:24:34.960917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 44/99] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:34 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:34.963023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 56/100] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:34 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:34.988350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:34.989248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:34.995279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.995880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.996461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:34.997422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:34.998021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:34.998470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:35.048436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:35.049363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:35.061109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:35.061690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:35.064058 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:35.071293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:35.071798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:35.073735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:35.280745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=8 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:35.436161 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:35.490412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:35.499972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:35.503909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a3f604ec-6475-4ca5-8306-a2372ea48afe tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.541424 Oct 27 01:24:35.504825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 45/101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:34 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:35.522477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2cf3c42b-e7c4-49fd-935f-18b17381b58c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.479759 Oct 27 01:24:35.523530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 57/102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:35 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:35.982818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:35.983430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:35.993102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:35.993725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:35.999947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.000425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.005127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.005869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.007481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.008095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.008761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.011165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.011803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.017494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.018845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.020233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.656898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:36.667280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a5930368-6d20-469a-b590-40a392906409 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.679043 Oct 27 01:24:36.669799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 58/103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:35 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:36.680146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:36.683375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:36.697164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:36.697653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.698785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.699594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.701678 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.702570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.703593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.715683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-18c855e1-1414-4d87-a94b-907e526a1de8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.736771 Oct 27 01:24:36.716267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 46/104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:35 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:36.736368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:36.737888 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:36.745048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.745833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.746536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:36.747429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:36.748082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:36.748707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:37.371503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:37.383890 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:37.394073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6a1bf940-8036-4088-a6c7-6d718417d9ac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.722397 Oct 27 01:24:37.394665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 59/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:36 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:37.396746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d3db2052-9cbf-4d17-93a5-09cfdb2486c2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.679254 Oct 27 01:24:37.400620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 47/106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:36 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:37.700901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:37.701941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:37.710491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:37.711255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:37.712313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:37.714024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:37.715305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:37.715858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:37.740700 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:37.741614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:37.753944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:37.756343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:37.757728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:37.760213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:37.763108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:37.764817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.213086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.226184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-71d3db4c-b400-4bb2-a67f-7dc6b0c01f7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.527951 Oct 27 01:24:38.241442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 48/107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:37 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:38.242065 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.251969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-540ba271-711d-49fb-80d7-f47accef8293 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.516465 Oct 27 01:24:38.254096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 60/108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:37 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:38.415945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:38.417418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:38.426365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:38.427737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:38.429908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:38.435903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:38.436536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.439202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:38.439683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:38.439805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:38.440389 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:38.441083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.444340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.450658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:38.451179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:38.451694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.816981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.820505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:38.830974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-98350d97-2fbf-412a-af69-3a56beccdb69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.418967 Oct 27 01:24:38.831595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-af389950-b7d1-4376-8a1c-165ca2b018e7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.410974 Oct 27 01:24:38.832795 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 61/109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:38 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:38.838335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3be4b-8f81-4b80-8f8d-801378971478", "tag": "1b044cc4-e3b6-4cc4-8cf5-d225498ee23b"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:38.855549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:38.856766 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:38.857587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:38.864007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 49/110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:38 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:38.878953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] Creating event network-changed:1b044cc4-e3b6-4cc4-8cf5-d225498ee23b for instance 6db3be4b-8f81-4b80-8f8d-801378971478 on hv-cinder-81558 Oct 27 01:24:38.885868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-ea612635-870a-4115-83db-7e2be833fb41 req-6f7ac303-e2f8-4ae1-93ac-5eb5e3270ca3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050898 Oct 27 01:24:38.886716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 62/111] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:39.256164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.256970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:39.267161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.267664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.268130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.272227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.272868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.273465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.280790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.281844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:39.293377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.294314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.295045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.296098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.296947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.297647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.622037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.635789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f0a2b939-3ddc-4f72-9a39-778c05265515 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.385149 Oct 27 01:24:39.649484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 50/112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:39 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:39.665015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:39.673627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b9cc4af7-1f77-46a1-a272-0eed795c03ba tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.398038 Oct 27 01:24:39.674142 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 63/113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:39 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:39.854984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.863951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:39.871683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.872378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.872957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.873926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.874373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.875187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.889296 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:39.890100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:39.906710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.907162 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.907675 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:39.908384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:39.908989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:39.909447 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:40.154701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:40.164395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4a96186d-8e59-474b-b8af-54aa2967cf57 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.313062 Oct 27 01:24:40.168477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 51/114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:39 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:40.172730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:40.189666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f616002f-8fba-4e01-8483-b580bd7841fb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.304442 Oct 27 01:24:40.193225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 64/115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:39 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:40.660979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:40.662224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:40.668548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:40.669223 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:40.669807 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:40.670770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:40.671385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:40.671950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:40.699948 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:40.700905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:40.721829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:40.740620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:40.743248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:40.745980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:40.746872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:40.750271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:40.979979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:40.990092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-28e7027c-3237-4957-9b88-ed3423a25a75 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.332880 Oct 27 01:24:40.994543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 52/116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:40 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:41.050771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.060077 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7e0bbb92-130e-4fbd-9442-a3be846f65f7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.364773 Oct 27 01:24:41.061464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 65/117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:40 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:41.194560 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:41.195396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:41.203305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:41.204341 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:41.204932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:41.206385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:41.206983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:41.207592 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:41.365025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.372696 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0822496c-517a-4e7d-9119-9715b03d2567 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.185836 Oct 27 01:24:41.385499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 66/118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:41 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:41.396885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:41.397525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:41.404027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:41.404518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:41.405135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:41.405837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:41.406292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:41.406718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:41.409582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:41.522179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56da46ce-164d-41a9-96f0-1e23257f43f1", "name": "network-vif-plugged", "status": "completed", "tag": "d74997a4-8058-410c-9e78-4a15650df34e"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:41.533104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:41.536600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:41.537276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:41.542495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:41.556218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] Creating event network-vif-plugged:d74997a4-8058-410c-9e78-4a15650df34e for instance 56da46ce-164d-41a9-96f0-1e23257f43f1 on hv-cinder-81558 Oct 27 01:24:41.566082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:41.571599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-7cd3589b-c2a2-420c-9f76-1206d1bae85e req-103ec4c5-e1a5-4297-b98d-88f402ce4a5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.392100 Oct 27 01:24:41.572284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 53/119] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:41.577372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5cc9fd1d-f5e9-44b8-8f9c-aa2135353376 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.190774 Oct 27 01:24:41.577951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 67/120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:41 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:42.014473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.015170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:42.021860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.022344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.022775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.023466 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.023917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.024339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.083815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.085084 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:42.091279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.092306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.092748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.093470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.094088 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.094519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.200744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.209168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-39bc7747-cc04-4cd9-8c01-ab02dd602e7f tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.198751 Oct 27 01:24:42.210031 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 54/121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:42 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:42.248058 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.256845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2bf46f4c-e6fd-4a69-93ed-408a02103135 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.176923 Oct 27 01:24:42.257510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 68/122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:42 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:42.403206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.404009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:42.410510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.410989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.411417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.412102 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.412546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.412962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.550429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.558784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8404aceb-6c27-4ee9-b0ee-a09906108c4c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.159608 Oct 27 01:24:42.559346 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 55/123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:42 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:42.600661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:42.601304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:42.607124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.607595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.608018 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.608693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:42.609172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:42.609579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:42.742006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:42.750255 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a1f9855-2da1-4801-be90-9ed71d21e639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.154413 Oct 27 01:24:42.751538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 69/124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:42 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:43.232083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.232689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:43.239136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.239617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.240039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.240948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.241441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.241853 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.285035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.285724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:43.294025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.294354 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.294795 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.295502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.295944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.296370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.463670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.471890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cf53192e-7015-4589-84f2-761a4d6a6862 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.242965 Oct 27 01:24:43.472442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 56/125] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:43 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:43.486585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.494338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c284fff4-4721-46d3-aae6-671902119562 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.215334 Oct 27 01:24:43.494898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 70/126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:43 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:43.582426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.582997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:43.588838 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.589354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.589795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.590483 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.590936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.591363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.722434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.730179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8a88ccbc-24cf-4e20-8cba-576f675d96e2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.152190 Oct 27 01:24:43.730746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 57/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:43 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:43.774611 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:43.775222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:43.781571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.782070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.782509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.783220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:43.783951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:43.784355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:43.915562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:43.923116 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-312a47ee-0f58-40be-b962-3bc638f19158 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.152431 Oct 27 01:24:43.923677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 71/128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:43 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:44.495367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.495971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:44.501815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.502827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.503348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.503933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.504380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.504802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.516856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.517511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:44.523877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.524348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.524772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.525486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.525930 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.526349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.701699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.709005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.709985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-83e869e9-2e05-42b0-bcaf-49fde32fc952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.218510 Oct 27 01:24:44.710557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 58/129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:44 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:44.717172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fc2c9e47-cb7d-4500-a8dd-0e4580616d9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.204116 Oct 27 01:24:44.717724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 72/130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:44 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:44.753964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.754572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:44.760470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.760944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.761418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.762106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.762552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.762972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.891275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:44.899207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d2fae62b-12b5-4ce6-9ad2-f09506391fa3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.150163 Oct 27 01:24:44.899774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 59/131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:44 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:44.946477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:44.947089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:44.952994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.953473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.953900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:44.954586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:44.955038 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:44.955468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:45.102723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:45.112345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e97178cc-e92e-48f9-a6f5-c78ccbc3a7d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.168972 Oct 27 01:24:45.113528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 73/132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:44 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:45.733547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:45.734084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:45.740179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:45.740347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:45.740859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:45.740957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:45.741128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:45.741794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:45.742247 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:45.742721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:45.748197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:45.748675 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:45.749245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:45.749962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:45.750405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:45.750820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:46.084789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.092848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c12189fb-1a8a-4435-ade4-71b978e69c6a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.363144 Oct 27 01:24:46.093530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 60/133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:45 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:46.100039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.106738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:46.107412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:46.108029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-567191c8-7086-44db-87f9-71cc4de45667 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.371888 Oct 27 01:24:46.108578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 74/134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:45 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:46.113967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:46.114450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:46.114876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:46.115589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:46.116039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:46.116458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:46.139475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:46.140165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:46.147037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:46.147601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:46.148100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:46.148878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:46.149455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:46.150230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:46.316041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.323564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-775949f2-70a0-43c5-b686-403daca904b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.220683 Oct 27 01:24:46.324228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 61/135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:46 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:46.327239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:46.335489 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5b36619f-76a6-42df-a15b-38367926f38a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.201544 Oct 27 01:24:46.336221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 75/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:46 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:47.123833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:47.124354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:47.131267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.131739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.131935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:47.132363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.132541 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:47.132838 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.133315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.133728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.138446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.138930 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.139359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.140044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.140492 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.140912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.326231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:47.329530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:47.335742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-34bf13be-b807-4b3c-a946-3131c3763564 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.215831 Oct 27 01:24:47.336611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 62/137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:47 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:47.337748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-525fbc75-7fa6-409e-9ea5-85d526a1c276 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.210222 Oct 27 01:24:47.338302 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 76/138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:47 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:47.358530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:47.359193 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:47.364734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:47.365343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.365477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:47.365939 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.366374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.367097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.367546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.367973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.371105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.371594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.372029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.372716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:47.373198 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:47.373622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:47.560352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:47.564315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:47.568741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dc9fec2a-559a-4c79-8497-418a45608621 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.213897 Oct 27 01:24:47.569349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 77/139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:47 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:47.572849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6dea2b34-bd9d-4832-8c09-feb592f32120 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.222521 Oct 27 01:24:47.573440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 63/140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:47 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:48.359618 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.360229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:48.360884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.361521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:48.366992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.367412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.367842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.368887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.369368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.369785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.369966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.370482 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.370995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.371700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.372271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.372725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.564946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.568861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.573079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1383d896-8d68-4606-bb76-c7f60c632f95 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.217347 Oct 27 01:24:48.576709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-69178b40-b0f5-495a-a5b7-a1573e2e4487 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.219569 Oct 27 01:24:48.587174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 64/141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:48 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:48.587501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 78/142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:48 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:48.592542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.593166 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:48.598536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:48.599139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:48.599588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.600071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.600499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.601215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.601668 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.602086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.604945 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.605468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.605898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.606570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:48.607015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:48.607431 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:48.794575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.798522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:48.803222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0ff4c5f7-4bca-45dd-a158-c215b390c1f8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.214365 Oct 27 01:24:48.803987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 65/143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:48 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:48.807748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-539e3d14-8e6b-441d-9f1d-49b892eebf55 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.214064 Oct 27 01:24:48.808315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 79/144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:48 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:49.595637 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.597493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:49.600255 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.600876 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:49.604063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.604273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.604872 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.605592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.606030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.606495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.607888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.608388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.608815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.609540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.609998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.610429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.796389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:49.804344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dbc1683a-6b88-496e-89dd-4e920f20343d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.212480 Oct 27 01:24:49.804909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 66/145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:49 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:49.808162 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:49.816633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-20319629-543c-4443-88bf-900835660f83 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.220946 Oct 27 01:24:49.817732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 80/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:49 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:49.826744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.827478 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:49.831648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:49.832252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:49.834360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.834898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.835328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.836006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.836453 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.836866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.838327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.838804 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.839233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:49.839915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:49.840357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:49.840773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:50.029088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.032378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:50.037296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b04a96fe-53bc-45ad-84f5-c73bf937d25e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.214504 Oct 27 01:24:50.037867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 67/147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:49 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:50.040412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8fa2ede4-3feb-45c0-9538-873d42f8e3e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.213409 Oct 27 01:24:50.040967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 81/148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:49 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:50.827388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:50.827997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:50.834918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:50.835464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:50.835928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:50.836611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:50.837072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:50.837492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:50.839551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:50.840190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:50.845952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:50.846436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:50.847719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:50.848140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:50.848592 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:50.849033 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:51.228188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.232257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.235824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-81100fa8-c759-4d1a-a5e8-94789e9dd7ed tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.412245 Oct 27 01:24:51.236385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 68/149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:50 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:51.241600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:51.242008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a012b18b-395a-4ddf-9952-453d40509345 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.406142 Oct 27 01:24:51.242335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:51.243995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 82/150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:50 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:51.247896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:51.248039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:51.248719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:51.248991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:51.249587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:51.250435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:51.251030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:51.251601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:51.255474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:51.255949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:51.256549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:51.257338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:51.257944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:51.258370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:51.443093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.447665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:51.449882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:51.451309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8bdc8b2e-0436-4ba7-ad90-21327a6a0a20 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.213938 Oct 27 01:24:51.451880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 69/151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:51 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:51.457390 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-402bf650-7c9d-4c2b-84eb-fd38a5876195 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.213677 Oct 27 01:24:51.457956 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 83/152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:51 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:52.258841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.259448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:52.265396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.265545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.265927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.266044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:52.266293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.266979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.267432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.267851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.272739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.273248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.273688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.274375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.274820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.275239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.286898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:52.462091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:52.465386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:52.469821 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7869cb18-8b4c-4f79-a398-3db554e4be07 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.214755 Oct 27 01:24:52.470391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 70/153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:52 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:52.474481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-bb8b53e9-9f15-477a-9c8c-23589b4bf58a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.211932 Oct 27 01:24:52.474764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 84/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:52 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:52.474866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.475433 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:52.480571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:52.481324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:52.481778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.482429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.483013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.483841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.484442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.485012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.487862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.488411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.488934 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.489736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:52.490183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:52.490608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:52.677624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:52.684184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:52.685786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-54f07e12-8e01-4905-a5c3-24302a280466 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.209154 Oct 27 01:24:52.686361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 85/155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:52 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:52.692500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7ccbaac2-207f-439c-a116-8a159cb2b171 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.221141 Oct 27 01:24:52.693070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 71/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:52 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:53.492914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:53.493661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:53.496921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:53.497554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:53.499651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.500128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.500557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.501264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.501709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.502123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.503263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.503744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.504581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.505301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.505752 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.506176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.696172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.702054 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.705508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b818dd74-8646-4377-8ac9-41f57d4aac2b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.216628 Oct 27 01:24:53.706089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 86/157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:53 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:53.711541 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:53.712213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:53.712970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dbefcd7d-63ff-40e7-b2c1-a11e5b7cbfcd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.219707 Oct 27 01:24:53.713891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 72/158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:53 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:53.718388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.718516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:53.718867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.719260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:53.719380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.720035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.720491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.720915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.726780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.726780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.727086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.727683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:53.728139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:53.728546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:53.918685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.921855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:53.926757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-54a5547e-15d8-4e8f-8c28-291eb5b1af50 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.219589 Oct 27 01:24:53.927343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 87/159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:53 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:53.930232 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9ecaa555-17a1-4905-b723-60e69238e69c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.215175 Oct 27 01:24:53.931048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 73/160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:53 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:54.737384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:54.738070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:54.742489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:54.743098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:54.744799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.745517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.745942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.746852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.747361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.747856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.749314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.749799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.750233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.750921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.751371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.751988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.944820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:54.948480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:54.952569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6e1b29a9-8612-425f-9945-725e543df16a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.219244 Oct 27 01:24:54.953253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 88/161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:54 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:54.956248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6a8004e0-7756-4ee0-ae1a-3de30fe76cdc tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.220581 Oct 27 01:24:54.969085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 74/162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:54 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:54.969239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:54.969239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:54.969379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:54.969379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:54.969613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.969613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.969613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.969613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.969864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.969864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.970001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.970001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.970001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:54.972101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:54.972101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:54.972101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:55.163553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:55.170744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:55.171953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2e0b6a0f-8547-4979-a68e-787ce7cf5f71 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.217811 Oct 27 01:24:55.172912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 89/163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:54 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:55.181349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c0f56ce3-7be6-4e1a-8f81-282561963f05 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.222572 Oct 27 01:24:55.182154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 75/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:54 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:55.359224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e412b-ed93-474b-9f25-0c643550c84c", "name": "network-vif-plugged", "status": "completed", "tag": "03b4b398-12c2-4b2b-b9c0-441545a05f75"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:55.369331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:55.369807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:55.370229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:55.383149 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] Creating event network-vif-plugged:03b4b398-12c2-4b2b-b9c0-441545a05f75 for instance f08e412b-ed93-474b-9f25-0c643550c84c on hv-cinder-81558 Oct 27 01:24:55.388394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-89326722-d5e4-49ab-b6d8-cc16a07c7c22 req-83a9e17a-e9b2-4cc6-9abf-f704ce5d1933 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Oct 27 01:24:55.389216 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 90/165] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:55.977018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:55.978111 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:55.983110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:55.983816 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:55.985969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:55.986709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:55.987356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:55.988908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:55.989592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:55.990365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:55.993808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:55.994968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:55.996043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:55.996872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:55.997320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:55.997749 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:56.205278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:56.217759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1f51c332-5687-426f-a70f-7dae9127f69b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.245523 Oct 27 01:24:56.219170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 76/166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:55 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:56.223178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:56.226004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:56.226640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:56.231772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5b50ecf1-7a9d-4e5e-ab36-1fc796d4acba tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.253501 Oct 27 01:24:56.243659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 91/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:55 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:56.253315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:56.253697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:56.254457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:56.254778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:56.254918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:56.256445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:56.256912 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:56.260146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:56.261190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:56.261677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:56.262350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:56.263858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:56.265191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:56.266367 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:56.499651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:56.512670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a6aa1875-5baa-40da-ae0c-855e1502e2a2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.287732 Oct 27 01:24:56.513706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 77/168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:56 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:56.540596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:56.549634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e9031405-410d-4efa-bd0f-380bcf41bfee tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.304496 Oct 27 01:24:56.551478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 92/169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:56 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:57.242184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.242856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:57.248841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.249369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.249806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.250492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.250947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.251375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.261247 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.262422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:57.269043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.269552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.270202 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.270896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.271344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.271975 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.464688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.469242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.479941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b1a74ffe-24c0-4afc-8fdc-e145cce88d2f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.242083 Oct 27 01:24:57.489746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 78/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:57 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:57.498469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f7b439af-e583-476c-8153-f18689d4f784 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.241199 Oct 27 01:24:57.499050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 93/171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:57 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:57.500524 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1923ce-640b-4bc6-b02b-722901af4b9f", "name": "network-vif-plugged", "status": "completed", "tag": "a826d83f-2f6e-4c48-b09b-56890b3a069f"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:24:57.505703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=89 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:57.510861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.511326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.511745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.523813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] Creating event network-vif-plugged:a826d83f-2f6e-4c48-b09b-56890b3a069f for instance fb1923ce-640b-4bc6-b02b-722901af4b9f on hv-cinder-81558 Oct 27 01:24:57.528985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-8126b161-51b7-4009-8dbc-377fa6adf771 req-a3c865f0-73d0-40c5-9713-1fdb5c57cb9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037666 Oct 27 01:24:57.529610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 79/172] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:24:57.535778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.536375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:57.542925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.543497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.543930 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.544613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.545068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.545503 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.578130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:57.578130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:57.585883 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.586445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.587067 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.587878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:57.588217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:57.589200 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:57.725316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.727154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7001fc8b-d59e-4730-b7d0-7f9d5c820b7d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.195272 Oct 27 01:24:57.727735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 94/173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:57 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:57.774345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:57.782281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b7d3a47a-db0b-4b17-8e11-52e27397a722 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.211052 Oct 27 01:24:57.782856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 80/174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:57 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:58.504375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.505524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:58.511504 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.511981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.512430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.513138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.513590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.514009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.524809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.527132 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:58.536824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.537400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.537829 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.538695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.539265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.539845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.735589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.747132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ee6f5f73-65a0-4e3d-b330-aa0104edd756 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.247130 Oct 27 01:24:58.747919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 95/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:58 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:58.752503 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.753554 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:58.763293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.763776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.764238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.764929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.765410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.765984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.778839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.786600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-acbcb38a-8e37-4f25-965e-1cf51436ca0e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.269132 Oct 27 01:24:58.787159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 81/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:58 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:58.807620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:58.808447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:58.814950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.815437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.815879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.816656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:58.817125 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:58.817706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:58.957606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.966996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-97b6dc3d-9974-49ba-8832-9951a0478a84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.217864 Oct 27 01:24:58.967675 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 96/177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:58 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:58.986998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:58.995134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-877177be-cf4c-4b95-b727-d04e0b60643a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.191573 Oct 27 01:24:58.995694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 82/178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:58 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:24:59.770914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.771511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:59.777438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:59.777907 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:59.778331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:59.779000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:59.779441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:59.779851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:59.809884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.810492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:59.816856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:59.817442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:59.817738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:59.818437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:59.818890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:59.819312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:24:59.969134 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.977458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-027242b8-dc33-4127-8290-31e76b000137 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.210790 Oct 27 01:24:59.978039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 97/179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:59 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:24:59.990507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:24:59.991222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:24:59.993451 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=98 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:24:59.997208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:24:59.998590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:24:59.999075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:24:59.999503 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:00.000191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:00.000634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:00.001051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:00.004958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c40ed9a1-c8e9-4d19-b94c-13005b9581f8 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.198787 Oct 27 01:25:00.005583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 83/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:59 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:00.022168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:00.022768 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:00.028433 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:00.028907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:00.029376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:00.030065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:00.030512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:00.030931 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:00.184125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.192391 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a20ef789-77fe-4c5b-930a-b87dc305028a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.205855 Oct 27 01:25:00.193082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 98/181] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:24:59 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:00.206636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:00.214641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d0e470e1-1bbf-4a78-be02-7b29ab706791 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.196358 Oct 27 01:25:00.215189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 84/182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:00 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:01.000495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:01.001146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:01.007392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.007867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.008299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.008983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.009460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.009882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.040607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:01.041676 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:01.049916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.051305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.051743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.052451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.052900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.053361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.287506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:01.298160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6b575344-421c-4f2b-bfb7-284556f2766a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.300110 Oct 27 01:25:01.309424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 99/183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:00 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:01.322667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:01.323188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:01.328313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:01.330664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.331491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.332145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.334349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.334974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.335745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.340685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3ce74f33-4aff-4e24-bc7c-66ac70e8890d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.315117 Oct 27 01:25:01.344811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 85/184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:01 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:01.351450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:01.352314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:01.358541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.359257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.359842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.360959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:01.361583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:01.362188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:01.663902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:01.666003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:01.671549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8bcb496c-fb5c-4765-8ec9-7705208ea732 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.361199 Oct 27 01:25:01.672301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 100/185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:01 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:01.673628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9b165335-d2c7-40a0-98da-9510d6c46b7a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.327510 Oct 27 01:25:01.674301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 86/186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:01 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:02.327179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:02.327812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:02.334671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.335148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.335577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.336250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.336694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.337135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.341163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:02.368906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:02.369535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:02.375945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.376511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.376947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.377659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.378103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.379037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.720056 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.735009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1633497e-1215-40b3-abfc-ca23fea1e8b7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.412057 Oct 27 01:25:02.736627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 101/187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:02 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:02.744814 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:02.747542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:02.750499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:02.755930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:02.757407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.758206 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.758842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.760594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.761321 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.761869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.762839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d70697f4-a754-48f3-875c-b0fe595ca6a1 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.397823 Oct 27 01:25:02.766097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 87/188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:02 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:02.777497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:02.778098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:02.786781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.787421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.788533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:02.789435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:02.790030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:02.790595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:03.002677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.025794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3ee202f8-8afd-4db4-8381-c1f7de8e9a6c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.285956 Oct 27 01:25:03.026513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 102/189] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:02 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:03.033368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0043e0-d539-46b1-bdd1-8adc22ef0d95", "name": "network-vif-plugged", "status": "completed", "tag": "9bbe4643-e570-4c73-9fd9-c977cef6c27c"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:03.042577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:03.053028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:03.054036 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:03.054612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:03.056422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0a0ec589-36e9-47da-8175-1bf1cddf0c0c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.287948 Oct 27 01:25:03.057763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 88/190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:02 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:03.069852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] Creating event network-vif-plugged:9bbe4643-e570-4c73-9fd9-c977cef6c27c for instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 on hv-cinder-81558 Oct 27 01:25:03.075503 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-70942328-c13d-48d8-b62d-d66c85ac755c req-1e7b4b90-7ee8-48d5-a73d-a788a478bae1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047541 Oct 27 01:25:03.076291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 103/191] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:03.759975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:03.761181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:03.767058 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:03.767477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:03.767916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:03.768603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:03.769045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:03.769684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:03.787197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:03.787972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:03.807467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:03.808031 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:03.808539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:03.809481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:03.810173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:03.810869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:04.025255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.032969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e0c4ae72-cf45-4ae1-a7b4-5cd5eab7be1f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.276867 Oct 27 01:25:04.033577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 89/192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:03 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:04.046151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.053282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:04.054214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:04.055807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-af4d6096-6de1-4851-b00a-a799a2cdef9e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.273584 Oct 27 01:25:04.056682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 104/193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:03 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:04.060947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:04.061542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:04.062050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:04.063116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:04.063598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:04.064190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:04.082125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:04.082742 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:04.090734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:04.091231 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:04.091731 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:04.092874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:04.093366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:04.093794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:04.284092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.290549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:04.293475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-17106cee-7f33-46e1-8591-f8dd9ec0c1d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.248228 Oct 27 01:25:04.294063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 90/194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:04 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:04.311457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ca828474-ca69-48f2-83fe-7b10813fca86 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.235372 Oct 27 01:25:04.312035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 105/195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:04 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:05.056689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.057553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:05.063468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.063939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.064365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.065045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.065518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.065941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.081343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.083003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:05.089233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.089718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.090190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.090927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.091366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.091794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.266131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.278366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-865f5eb0-c695-4756-b31f-95fd68a27142 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.225786 Oct 27 01:25:05.282085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.287047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 91/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:05 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:05.295633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-80fbb21c-684d-4632-a586-598e167b278a tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.218209 Oct 27 01:25:05.296368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 106/197] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:05 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:05.317850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.318378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:05.324282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.324765 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.325303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.326030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.326474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.326892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.336610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:05.337437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:05.344394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.345157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.345582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.346706 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:05.347165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:05.348830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:05.546652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.556617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:05.564325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-36e98e17-dda5-4ca9-8c46-1ae5ef711de3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.232571 Oct 27 01:25:05.565109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 107/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:05 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:05.568679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-402993c9-4315-42f0-beb5-ce71a9c72270 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.255314 Oct 27 01:25:05.569865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 92/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:05 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:06.309191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.309803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:06.316735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.317450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.317902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.318602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.319054 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.319478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.320181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.320791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:06.326775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.327249 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.327679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.328366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.328811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.329269 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.516067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.518881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.523929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e6ba83d9-be2b-4ecd-85e8-26dc94433d3e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.218825 Oct 27 01:25:06.527448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b673bff9-a196-43f2-82b1-2f0f4010eb43 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.211816 Oct 27 01:25:06.528014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 93/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:06 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:06.532595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 108/201] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:06 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:06.588047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.588586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:06.590732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:06.591338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:06.594706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.595179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.595614 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.596328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.596767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.597037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.597773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.598118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.598555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.599233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:06.599687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:06.600105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:06.791665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.795176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:06.799338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bd69ce96-3d90-459f-9b92-c0fda3b578bc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.215145 Oct 27 01:25:06.800118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 94/202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:06 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:06.802811 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e037596f-fdb4-4643-a61d-69f40b42b87a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.215730 Oct 27 01:25:06.803521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 109/203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:06 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:07.547153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:07.547866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:07.550183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:07.551333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:07.554172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.554661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.555093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.556053 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.556498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.556918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.557805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.558352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.558850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.559605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.560121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.561652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.748786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:07.756039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:07.757498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c1a71a64-e06c-424c-8f8c-5a3ab065e9ef tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.214213 Oct 27 01:25:07.758289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 95/204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:07 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:07.763931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9e894928-d23c-4e1a-bb6f-25af7e0a6758 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.217960 Oct 27 01:25:07.764502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 110/205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:07 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:07.822886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:07.823487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:07.825851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:07.826461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:07.829716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.830273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.830783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.831571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.832173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.832370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.832596 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.832862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.833333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:07.834015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:07.834511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:07.834918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:08.026225 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.030132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:08.034134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d782da96-1f12-47c4-ae93-421882fb3d07 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.215051 Oct 27 01:25:08.034778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 96/206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:07 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:08.037958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d1597b4f-ca07-483f-966f-8150d68cb0fc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.215855 Oct 27 01:25:08.038514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 111/207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:07 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:08.780772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:08.781481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:08.787809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:08.788253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:08.788434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:08.788852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:08.788964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:08.789592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:08.790045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:08.790540 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:08.795005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:08.795486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:08.795923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:08.796612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:08.797078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:08.797932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:08.998900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.002575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.009254 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-cab699eb-afff-4e03-9f33-2e0996786efd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.225857 Oct 27 01:25:09.009824 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 112/208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:08 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:09.010158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-35567f90-956e-4c37-a132-1b94c4b26878 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.233137 Oct 27 01:25:09.010712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 97/209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:08 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:09.057406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:09.058003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:09.060665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:09.061295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:09.064228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:09.064704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:09.065169 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:09.065978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:09.066707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:09.066828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:09.067262 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:09.067740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:09.068179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:09.069005 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:09.069487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:09.069909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:09.277029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.286873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:09.287805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fb708971-05e8-45e7-9a49-cdb77c95a311 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.234244 Oct 27 01:25:09.288461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 113/210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:09 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:09.294926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4625b274-2743-49e5-b3e6-8a2607466815 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.238196 Oct 27 01:25:09.296019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 98/211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:09 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:10.031604 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.032191 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.032586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:10.032688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:10.038821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.039306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.039927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.040776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.041408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.041980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.042761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.043355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.043904 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.044715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.045557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.046026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.257633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:10.266878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2172daa3-f16f-48f0-93ed-f29c9eadaf14 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1321 microversion: 2.1 time: 0.239003 Oct 27 01:25:10.268141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 114/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:10 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:10.274913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:10.283365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-880943d2-c339-4aac-a6df-e3a9a112332c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1315 microversion: 2.1 time: 0.255495 Oct 27 01:25:10.283922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 99/213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:10 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:10.311757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.312426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:10.319109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.319408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:10.319578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.320003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.320197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:10.320682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.321165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.321581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.326274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.326849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.327346 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.328102 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:10.328623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:10.329143 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:10.516242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:10.519479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:10.525426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8de62fc1-a583-4469-a2f3-84876572bf44 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.217224 Oct 27 01:25:10.526416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 115/214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:10 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:10.543674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2bedab11-4374-46f2-b8ad-54dabdca66fb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.228648 Oct 27 01:25:10.544263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 100/215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:10 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:11.297530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.298139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:11.305143 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.305887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.306316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.307002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.307443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.307855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.308621 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.309250 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:11.315444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.316003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.316647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.317585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.318787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.319278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.522199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.531066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a92bfd2a-886b-4b2e-a6b5-40ac91c8ee32 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1515 microversion: 2.1 time: 0.237326 Oct 27 01:25:11.531850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.531995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 116/216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:11 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:11.540699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3c474cbd-3888-4f96-a1b9-2feb772a3952 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1503 microversion: 2.1 time: 0.236420 Oct 27 01:25:11.552139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.552139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:11.553458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 101/217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:11 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:11.556351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.557414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.558184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.559164 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.559825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.560599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.561416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:11.564399 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:11.570826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.571324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.571766 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.572469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.573704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.574850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.650508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lazy-loading 'flavor' on Instance uuid fb1923ce-640b-4bc6-b02b-722901af4b9f {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:11.732115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.740811 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-de2f8fee-b581-4c53-81b3-beab3eb45c3b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.196765 Oct 27 01:25:11.742003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 117/218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:11 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:11.746580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:11.747330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:11.754076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.754899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.756213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.757273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:11.758417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:11.759130 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:11.778874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:11.957292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:11.980962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8a152dd5-b410-442b-9cbf-785136f3ba9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.237721 Oct 27 01:25:11.981782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 118/219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:11 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:11.989659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:12.023368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bc3251a3-882d-4138-b12a-6fb2cf2ce2e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f/action" status: 200 len: 32 microversion: 2.1 time: 0.467964 Oct 27 01:25:12.024268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 102/220] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:25:11 2022] POST /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:25:12.036235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:12.036235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:12.046957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:12.048205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:12.049350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:12.050319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:12.050963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:12.051569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:12.197808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.205983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-aad185e2-791e-4da0-a60f-773d6eccaffb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.175997 Oct 27 01:25:12.206633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 119/221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:12 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:12.769817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:12.770446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:12.778017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:12.778504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:12.778936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:12.779636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:12.780078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:12.780496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:12.915997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:12.923765 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-220fc84d-14eb-4e40-9a11-9b46bdcd3ac3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.158269 Oct 27 01:25:12.924328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 103/222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:12 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:13.009022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:13.009732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:13.015756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.016228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.016671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:13.017402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.017848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.018264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:13.158568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:13.166978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7605a11b-ec6e-4867-965f-1eed92ede236 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.162081 Oct 27 01:25:13.167550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 120/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:13 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:13.231079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:13.231684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:13.237597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.238076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.238508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:13.239188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.239664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.240086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:13.374306 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:13.382439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eb278831-b049-4d83-a1e1-b10410bacc4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.155116 Oct 27 01:25:13.382994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 104/224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:13 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:13.951453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:13.952338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:13.959066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.959969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.960309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:13.961009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:13.961585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:13.962009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:14.092568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.100192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a8e2de5-f06a-46b4-8db8-20a5eb5a1de0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.152663 Oct 27 01:25:14.100748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 121/225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:13 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:14.189627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:14.190224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:14.196702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:14.197200 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:14.197628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:14.198300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:14.198741 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:14.199154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:14.327663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.336061 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ff952cfe-b908-4313-885b-a5cc6d07b80c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.150162 Oct 27 01:25:14.336629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 105/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:14 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:14.408130 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:14.408738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:14.416217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:14.416217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:14.416217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:14.416546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:14.416822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:14.417273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:14.544693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:14.552782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-03c95cf8-211e-4a24-93c7-a61488e74847 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.148074 Oct 27 01:25:14.553395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 122/227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:14 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:15.123619 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:15.124226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:15.130666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.131238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.131722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.132414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.132866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.133326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.266727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.274392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3f01fde7-973e-4aaa-b8be-1961650a66e9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.154580 Oct 27 01:25:15.274950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 106/228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:15 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:15.358483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:15.359089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:15.365622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.365984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.366453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.367178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.367577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.368044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.498612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.507597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6f22c05a-e1b5-4f5c-b258-e8a1ba617d45 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.152946 Oct 27 01:25:15.508159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 123/229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:15 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:15.575588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:15.576126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:15.581990 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.582469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.582901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.583625 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:15.584079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:15.584496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:15.711675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:15.719263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ef8c1b31-2764-4b24-864d-81df5d0d4cb4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.147546 Oct 27 01:25:15.719820 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 107/230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:15 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:16.296883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:16.297433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:16.303807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.304287 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.304716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.305678 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.306136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.306551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.444681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.452753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f082813b-7e9c-417f-8bba-7f70f4bc36bd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.159628 Oct 27 01:25:16.453694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 124/231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:16 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:16.530094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:16.530700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:16.537200 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.537755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.538201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.538892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.539522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.539948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.672950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.681565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cbae2f6c-f40c-45ac-9684-f8c88c385a4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.155219 Oct 27 01:25:16.682242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 108/232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:16 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:16.744025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:16.744649 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:16.751043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.751523 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.751952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.752644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:16.753112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:16.753534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:16.886402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:16.893973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-13e4bcfc-8558-4542-a6e8-53e58a542d59 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.154949 Oct 27 01:25:16.894537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 125/233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:16 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:17.477162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:17.477758 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:17.483601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.484071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.484495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:17.485226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.485670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.486083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:17.617105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.624900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-35c7186b-5fc8-41b4-8b51-d7ccc6c04c40 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.152800 Oct 27 01:25:17.625473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 109/234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:17 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:17.705746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:17.706351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:17.713779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.714290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.714720 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:17.715441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.715883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.716336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:17.847904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:17.856543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5d8918b2-b1c6-4e39-b240-88d375fa98bb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.154580 Oct 27 01:25:17.857482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 126/235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:17 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:17.916962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:17.917606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:17.923478 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.923951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.924385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:17.925081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:17.925540 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:17.925961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.056547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:18.064620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-15eb41fa-dd75-4535-ad92-b3039dd5508b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.151496 Oct 27 01:25:18.065358 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 110/236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:17 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:18.392929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24d9b5a4-ac98-439a-a72d-92c84b2059cc"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:18.395359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:18.401959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.402435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.402867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.403544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.403990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.404412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.649835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:18.650456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:18.656261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.656741 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.657206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.657893 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.658519 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.658739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.818039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:18.834342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7e5d5cce-461f-4fe2-9db1-4ed929d40e5e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.190548 Oct 27 01:25:18.837107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 111/237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:18 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:18.880281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:18.881156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:18.887587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.888717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.890225 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:18.891138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:18.891585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:18.892016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:19.040486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:19.050097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dca0f147-7ae0-4a09-89a6-74c6e0a28866 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.174048 Oct 27 01:25:19.050666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 112/238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:18 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:19.088212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:19.088810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:19.096286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:19.096689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:19.097144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:19.097835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:19.098277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:19.098694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:19.257820 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:19.266115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-928c348f-1ca7-405d-a216-c3b31f2ec7f0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.181231 Oct 27 01:25:19.266279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 113/239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:19 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:19.859542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:19.860147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:19.866568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:19.867039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:19.867470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:19.868146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:19.868616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:19.869034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:20.006654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.014553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-355df8a7-b4cc-472e-a0c4-a37306078eb5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.158972 Oct 27 01:25:20.015342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 114/240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:19 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:20.072891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:20.073528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:20.080017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:20.080529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:20.080965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:20.081707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:20.082211 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:20.082590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:20.223100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.231438 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5d8fbeeb-e1e4-4055-8fde-bcbd920561a6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.163015 Oct 27 01:25:20.231995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 115/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:20 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:20.293357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:20.293995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:20.300181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:20.300659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:20.301117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:20.302413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:20.302985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:20.303404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:20.436809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:20.444547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-475569a6-fa82-4a3b-858b-7a76ce862b0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.154936 Oct 27 01:25:20.445135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 116/242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:20 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:21.038592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:21.039217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:21.044902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.045414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.045844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.046531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.046978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.047434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.176204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.184967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e9ef2cb3-d848-4906-b4e7-493981eab472 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.150819 Oct 27 01:25:21.185563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 117/243] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:21 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:21.256502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:21.257123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:21.264469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.264843 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.265682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.266384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.266836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.267253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.402176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.410456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5316df4f-261e-475c-8a71-5c0b1cfb698b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1368 microversion: 2.1 time: 0.159654 Oct 27 01:25:21.411205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 118/244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:21 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:21.471866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:21.472879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:21.493273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.493273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.493273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.493273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:21.493575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:21.493575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:21.493575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:21.871953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:21.880841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-425b4710-20b4-4a35-8711-a8a19dddd809 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.415573 Oct 27 01:25:21.881627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 119/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:21 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:22.208084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.209339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:22.219237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.219753 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.221447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.223781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.224928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.224928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.417039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e5b50a7c-30ec-43b4-a0e7-145ec38bf2fd tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "POST /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.028100 Oct 27 01:25:22.418722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 127/246] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:25:18 2022] POST /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1/os-volume_attachments => generated 194 bytes in 4031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:22.445533 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.446448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:22.470869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.471724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.472488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.480047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.480818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.481770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.486105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.529253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b0dec851-bd6c-4e6f-ac92-4448da319639 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.324371 Oct 27 01:25:22.529641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 120/247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:22 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:22.773992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:22.785434 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f804aba4-8f61-471d-8276-510aa0e55e81 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1558 microversion: 2.1 time: 0.346584 Oct 27 01:25:22.788302 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 128/248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:22 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1558 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:22.816052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.816544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:22.829811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.830300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.830742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.831444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.831890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.834444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.906446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:22.907178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:22.931802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.935046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.941081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:22.942221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:22.945399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:22.947385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:23.150119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4b8369d3-f134-479c-8236-4002cdeb8f63 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.338355 Oct 27 01:25:23.151461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 121/249] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:25:22 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-interface => generated 284 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:23.578660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:23.579345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:23.591738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:23.597565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:23.600370 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:23.604793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:23.606596 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:23.608604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:23.831570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:23.857352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b92d9da0-cd0c-4f98-8c6c-01851eddd7da tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.956403 Oct 27 01:25:23.860835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 129/250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:22 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:24.380355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:24.390550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-66080276-0464-41e4-a2a8-dbe66495335e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.818778 Oct 27 01:25:24.391859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 122/251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:23 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:24.887550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:24.888156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:24.894887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:24.895798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:24.896238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:24.897292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:24.897698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:24.898527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:25.186923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:25.197750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1706e429-9196-4d63-b463-1a114773acd4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.314492 Oct 27 01:25:25.203241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 130/252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:24 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:25.420432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0043e0-d539-46b1-bdd1-8adc22ef0d95", "tag": "9bbe4643-e570-4c73-9fd9-c977cef6c27c"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:25.421999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:25.422710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:25.440897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:25.442307 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:25.443026 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:25.446246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:25.447127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:25.447849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:25.452809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:25.454234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:25.457126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:25.486696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] Creating event network-changed:9bbe4643-e570-4c73-9fd9-c977cef6c27c for instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 on hv-cinder-81558 Oct 27 01:25:25.499204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-fcf98f10-b83c-4de8-b223-a24d55c2ad23 req-0ee4c8b9-b079-47fe-96a6-cd53812a4dcc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083503 Oct 27 01:25:25.501283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 123/253] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:25.611630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3be4b-8f81-4b80-8f8d-801378971478", "name": "network-vif-plugged", "status": "completed", "tag": "1b044cc4-e3b6-4cc4-8cf5-d225498ee23b"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:25.627624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:25.633404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:25.634628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:25.665304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] Creating event network-vif-plugged:1b044cc4-e3b6-4cc4-8cf5-d225498ee23b for instance 6db3be4b-8f81-4b80-8f8d-801378971478 on hv-cinder-81558 Oct 27 01:25:25.672192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-67518e32-12f3-4d6f-b002-55e879738d0b req-425fc16a-e526-4e3c-a420-c5dcc9c4682f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079620 Oct 27 01:25:25.672815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 124/254] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:25:25.786430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:25.813045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7877acf9-5429-4ad2-bbae-04b12b55139e tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.398731 Oct 27 01:25:25.820027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 131/255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:25 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:25.858196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1110692729", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:25.948130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] validate_networks() for None {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:25:26.227847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:26.228589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:26.241312 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.241973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.242409 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.243347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.243808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.244234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.614021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:25:26.615264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:25:26.615496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:25:26.615826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:25:26.616244 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:25:26.632812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.633501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.633936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.634656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.638962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.639581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.670775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:26.679276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-972b2df1-389d-49d9-b6b2-a3d08fb70c68 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.455916 Oct 27 01:25:26.679864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 132/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:26 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:26.709769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Getting quotas for project f135389d386e43d58581df01f80c083c. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:25:26.715462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Getting quotas for user 2ac8bc3fb2734e979ae50aff1a6e905e and project f135389d386e43d58581df01f80c083c. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:25:26.719582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:26.731497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:25:26.736715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:25:26.795729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-12692f3b-4e98-44e9-a099-21fb00353f9c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941746 Oct 27 01:25:26.803719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 125/257] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:25:26.808834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-17999d6b-1ab2-4207-b3c2-c35b1ae83d46 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:26.809467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-17999d6b-1ab2-4207-b3c2-c35b1ae83d46 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:26.842092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:26.842764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:26.867714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.868450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.880542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.881384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:26.881874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:26.882298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:26.962790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-17999d6b-1ab2-4207-b3c2-c35b1ae83d46 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:26.971956 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-17999d6b-1ab2-4207-b3c2-c35b1ae83d46 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1215 microversion: 2.1 time: 0.167342 Oct 27 01:25:26.975359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 133/258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:26 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:27.193015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.204835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-524bd8ab-03b7-4fea-b8f7-20b2275d0b32 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1361 microversion: 2.1 time: 0.366680 Oct 27 01:25:27.205666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 126/259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:26 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:27.704124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:27.705714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:27.714892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:27.715791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:27.716412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:27.717356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:27.717950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:27.718552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:27.885600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:27.892416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:27.907378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-48e879c9-5431-4e23-b93e-bfbaee7a23de tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.207913 Oct 27 01:25:27.907954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 134/260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:27 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:28.003650 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.004284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:28.016673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.018671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.019219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.020394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.021131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.021729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.121088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.129215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f86eda70-25c0-4654-9b18-b6a8d81fb94c tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1267 microversion: 2.1 time: 0.130868 Oct 27 01:25:28.130434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 127/261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:27 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1267 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:28.243468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.246262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:28.266625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.267351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.268227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.269520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.270137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.276511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.476691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:28.484798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-61cf8228-036e-4cf0-abce-0c08e047de73 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1547 microversion: 2.1 time: 0.257081 Oct 27 01:25:28.485321 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 135/262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:28 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1547 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:28.516157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.524009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:28.534184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.535065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.545292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.546331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.546919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.547376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.639230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7b5a90d7-530d-4bd3-a70e-0df4d543295b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126838 Oct 27 01:25:28.654828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 128/263] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:25:28 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:28.932691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:28.934037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:28.955576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.956197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.956644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:28.957704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:28.957801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:28.958220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:29.153681 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:29.154301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:29.161879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:29.167046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:29.167046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:29.183620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:29.184187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:29.184594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:29.325415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:29.340541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-492e94f9-7e05-4a55-a3c3-3c620a5d2a1b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1267 microversion: 2.1 time: 0.191063 Oct 27 01:25:29.341700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:29 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:29.355003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:29.363663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c46afd6e-1736-4c30-8e4b-ebbeba1ef2c4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.435114 Oct 27 01:25:29.364780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 136/265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:28 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:30.363825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:30.366459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:30.380090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:30.380791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:30.390598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:30.391448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:30.391934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:30.392052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:30.392423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:30.394270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:30.405566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=80 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:30.408208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:30.408853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:30.409320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:30.414146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:30.414146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:30.414146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:30.528786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:30.550092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-532c704a-3f0c-4967-8ba3-8ec79641d997 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1285 microversion: 2.1 time: 0.189409 Oct 27 01:25:30.550697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 130/266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:30 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:30.560138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3be4b-8f81-4b80-8f8d-801378971478", "tag": "1b044cc4-e3b6-4cc4-8cf5-d225498ee23b"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:30.575028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:30.576332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:30.577325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:30.592181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] Creating event network-changed:1b044cc4-e3b6-4cc4-8cf5-d225498ee23b for instance 6db3be4b-8f81-4b80-8f8d-801378971478 on hv-cinder-81558 Oct 27 01:25:30.599284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-2ed4a5ff-ec5d-4be2-b672-b6c2edd6f95d req-dc6ad085-4f14-4dcf-afef-dfe3636fa1c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045815 Oct 27 01:25:30.600424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 131/267] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:30.619541 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:30.628124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a9eedacd-bdf7-4549-b745-7338d4a58d52 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.242615 Oct 27 01:25:30.628860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 137/268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:30 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:31.578729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:31.580042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:31.589299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:31.590036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:31.590680 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:31.591600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:31.592248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:31.592886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:31.653827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:31.655224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:31.665813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:31.666616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:31.667379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:31.668332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:31.669007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:31.669683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:31.682947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:31.698810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d15aeaf9-f986-4fb6-9f30-ec3ecdf0ebbd tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1285 microversion: 2.1 time: 0.121711 Oct 27 01:25:31.701241 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 132/269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:31 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:31.843237 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:31.853547 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-59ebb72f-3b5b-4c23-aa54-373126ce8016 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.203955 Oct 27 01:25:31.854508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 138/270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:31 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:32.728209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.728884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:32.734836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:32.735770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:32.736263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:32.737210 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:32.737736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:32.738395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:32.821079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:32.829802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d7193607-4036-42ce-b633-d08a28cefa3f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1273 microversion: 2.1 time: 0.106160 Oct 27 01:25:32.830525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 133/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:32 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:32.878276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:32.880299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:32.887058 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:32.887573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:32.888064 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:32.888754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:32.889439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:32.889988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.088636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:33.123283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ade2d388-c5ec-43e5-ad1d-ad9f2fbebb2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.229224 Oct 27 01:25:33.148599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 139/272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:32 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:33.605136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:33.605624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:33.611598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.612076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.612507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.613324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.613999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.615212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.649160 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:25:33.769096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ac99f745-21cf-465d-875e-2843545a0015 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 204 len: 0 microversion: 2.1 time: 0.167211 Oct 27 01:25:33.772806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 134/273] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:25:33 2022] DELETE /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:25:33.778583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:33.779243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:33.786975 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.787856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.788688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.789691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.790145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.790596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.854418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:33.855349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:33.861468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.862780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.863384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:33.864972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:33.865780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:33.866379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:34.001041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.010306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0162d50a-788e-4e44-bd3f-1b620518a338 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1555 microversion: 2.1 time: 0.236317 Oct 27 01:25:34.011173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 140/274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:33 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:34.041813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123f8483-ead8-4696-bad4-a0144565fa6d", "tag": "ef4dbd6f-2b59-4996-ac64-47b97d0e16c7"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:34.052347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:34.052953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:34.053505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:34.054860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.063150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-660964f4-4946-433e-9265-d2947dc702b1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.212857 Oct 27 01:25:34.065420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 135/275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:33 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:34.066633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] Creating event network-changed:ef4dbd6f-2b59-4996-ac64-47b97d0e16c7 for instance 123f8483-ead8-4696-bad4-a0144565fa6d on hv-cinder-81558 Oct 27 01:25:34.079305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-494dc706-7b86-4cb4-828f-9ba2907ef7e7 req-23f04459-d506-4562-9aac-90dfb1b06134 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052374 Oct 27 01:25:34.080063 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 141/276] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:34.157629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:34.158642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:34.165664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:34.166251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:34.166751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:34.167560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:34.168093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:34.168582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:34.312205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:34.321967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a4358e77-43be-4227-8e22-0d7d53684285 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.169194 Oct 27 01:25:34.322764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 136/277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:34 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:35.042500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:35.043312 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:35.052748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.053725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.054410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.055606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.056136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.056631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.087919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:35.088525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:35.097012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.097519 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.097951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.099885 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.100340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.100934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.123816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:35.370743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.378275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-93e12a3b-705f-4206-afe8-03b352d6f494 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.294172 Oct 27 01:25:35.382087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.391256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9542c252-e415-4e57-aeb9-20c4daa3480b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1555 microversion: 2.1 time: 0.356286 Oct 27 01:25:35.392232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 142/278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:35 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:35.393404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 137/279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:35 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:35.398509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:35.399310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:35.405347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.406032 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.406467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.407338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:35.407944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:35.408527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:35.545240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:35.554579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2249d8b0-a934-4da6-a57c-81e137eef823 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.160958 Oct 27 01:25:35.555501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 143/280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:35 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:36.402459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:36.403100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:36.413941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.414676 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.415280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.416140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.418202 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:36.419226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.419722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:36.419858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.430428 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.432207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.432814 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.433910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.435043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.435774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.661672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:36.674820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.677778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.686727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-40e20419-1a1e-45a8-ba15-ce88da8369a6 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.288005 Oct 27 01:25:36.701085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 138/281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:36 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:36.701085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:36.701085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:36.701463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5e5a2ab1-1115-487e-938e-872902bb9644 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1555 microversion: 2.1 time: 0.281191 Oct 27 01:25:36.701463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 144/282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:36 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:36.701626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.701626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.701626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.701626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:36.701949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:36.702038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:36.726719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:36.874599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:36.891302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ad730e4b-d520-44b7-9da5-06ff476fd888 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.202573 Oct 27 01:25:36.891892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 139/283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:36 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:37.693506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56da46ce-164d-41a9-96f0-1e23257f43f1", "name": "network-vif-deleted", "tag": "d74997a4-8058-410c-9e78-4a15650df34e"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:37.699075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:37.712498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.712857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.713664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.728285 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.728799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] Creating event network-vif-deleted:d74997a4-8058-410c-9e78-4a15650df34e for instance 56da46ce-164d-41a9-96f0-1e23257f43f1 on hv-cinder-81558 Oct 27 01:25:37.729608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:37.735997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.736539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.736973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.737696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.740098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-eccbe362-b3f4-4634-8c84-e936342b013e req-2b71cddc-958e-4428-ab52-70f8f52f78cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050631 Oct 27 01:25:37.741041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 145/284] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:37.744736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.747436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.748136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:37.749023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.765767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.766644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.767249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.768096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.768697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.769286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.847341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:37.857649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e3bdb590-2b5a-479b-b089-2e24c4627ef6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.134434 Oct 27 01:25:37.858974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 140/285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:37 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:37.916881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:37.917704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:37.924197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.924611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.925038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.925757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:37.926720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:37.927308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:37.948046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:37.955513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c950d245-77ed-4afb-a13e-b5ba592731e7 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.213366 Oct 27 01:25:37.956073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 146/286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:37 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:38.053116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:38.060967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cd92ad81-ed3f-4db6-97d9-9f19cbaf00eb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.148015 Oct 27 01:25:38.061569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 141/287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:37 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:38.882306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:38.882912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:38.889223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:38.889703 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:38.890146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:38.890838 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:38.891286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:38.891709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:38.951957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:38.960099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6e560411-cbb9-472e-aaaa-fb8f9ab0010d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.082072 Oct 27 01:25:38.960653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 147/288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:38 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:38.979250 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:38.979861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:38.985774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:38.986257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:38.986695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:38.987388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:38.987845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:38.988301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:39.085855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:39.086567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:39.093180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:39.093680 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:39.094166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:39.094856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:39.095313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:39.095740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:39.124717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:39.133603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-83177eeb-d581-4d89-914d-15982e3635ce tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.158137 Oct 27 01:25:39.134702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 142/289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:38 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:39.231314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:39.239527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5b2de373-fca6-4bc3-bd72-884a051d02d7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.158355 Oct 27 01:25:39.240545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 148/290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:39 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:39.983632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:39.984249 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:39.991181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:39.991666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:39.992105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:39.992798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:39.993283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:39.993710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:40.056499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:40.064692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5584c329-f581-4300-ba57-4a5bfe80b405 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.084842 Oct 27 01:25:40.065513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 143/291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:39 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:40.156687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:40.157338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:40.164087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:40.164561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:40.164988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:40.165694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:40.166138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:40.166585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:40.263719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:40.264317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:40.270739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:40.271224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:40.271654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:40.272342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:40.272783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:40.273233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:40.297146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:40.305807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-47731083-31db-462c-8fe2-06f579b6ebcc tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.152898 Oct 27 01:25:40.306468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 149/292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:40 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:40.400397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:40.408266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4e32de7c-ad18-4b7d-94b3-f51320a12c0a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.148345 Oct 27 01:25:40.408827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 144/293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:40 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:41.089244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:41.089767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:41.095846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.096327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.096761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.097470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.098530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.098970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.162705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:41.171504 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-67cf50ef-e978-4007-95d8-e6cc33e728de tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.086339 Oct 27 01:25:41.172068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 150/294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:41 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:41.328502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:41.329149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:41.335351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.335837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.336274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.336964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.337445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.337874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.431438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:41.432047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:41.439359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.439854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.440290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.440988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:41.441468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:41.442023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:41.468316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:41.476403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-28cb80de-bdf3-414d-9b9b-027acaf5d8f1 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.151713 Oct 27 01:25:41.476968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 145/295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:41 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:41.571082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:41.578676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9604c4de-de06-40ef-93a0-adba69ec7717 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.151316 Oct 27 01:25:41.579233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 151/296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:41 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:42.201241 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:42.201841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:42.207929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.208418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.208849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.209588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.210040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.210460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.271459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:42.279510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d3f52125-b2e0-461c-8f7d-c1b9a68e8cd6 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.082193 Oct 27 01:25:42.280075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:42 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:42.501025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:42.501584 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:42.508707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.509225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.509664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.510349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.510798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.511219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.602586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:42.603499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:42.611616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.612361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.612851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.614605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:42.615019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:42.615825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:42.647285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:42.649601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:42.656321 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2eb85232-7be2-4c22-831a-fea841b0c06d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.159199 Oct 27 01:25:42.657236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 152/298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:42 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:42.742567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:42.750140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c991a9bf-8092-4b52-9eee-c55e078ca940 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.152702 Oct 27 01:25:42.750698 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 147/299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:42 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:43.301899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:43.302506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:43.308663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.309178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.309614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.310297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.310748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.311170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.374568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:43.383225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1e01973a-254d-4fab-a4b7-0127fce6e59e tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.085422 Oct 27 01:25:43.383781 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 153/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:43 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:43.680382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:43.680992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:43.686968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.687447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.687884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.688574 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.689023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.689468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.773834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:43.774447 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:43.780719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.781235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.781672 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.782357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:43.782805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:43.783228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:43.815446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:43.825041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e393e77b-4f6c-435c-9cc2-480baa930aed tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.149251 Oct 27 01:25:43.825636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 148/301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:43 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:43.908923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:43.917136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-76402820-069b-4d23-b3f8-38b9a5ddc01f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.147717 Oct 27 01:25:43.917692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 154/302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:43 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:44.406854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:44.407457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:44.413546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.414023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.414457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.415148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.415595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.416018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.481943 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:44.491252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-773b315a-dd62-4e4e-b67b-2d6a9c22d511 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.088206 Oct 27 01:25:44.491844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 149/303] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:44 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:44.848608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:44.849236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:44.855897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.856374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.856801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.857507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.857950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.858395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.940202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:44.940810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:44.947299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.947785 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.948254 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.948948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:44.949455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:44.949882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:44.984585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:44.992991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5851a37c-dbe2-4565-887b-9c5ad76c6fb8 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.148752 Oct 27 01:25:44.993587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 155/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:44 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:45.076623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:45.084351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7362f08a-f861-45f8-8a85-7e9fd912bab5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.148026 Oct 27 01:25:45.084913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 150/305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:44 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:45.514564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:45.515159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:45.529113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:45.529673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:45.530172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:45.531000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:45.531583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:45.532083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:45.615479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:45.623597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dc3dbd2b-9d05-4a56-a0c1-994a56c59877 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1513 microversion: 2.1 time: 0.113226 Oct 27 01:25:45.624380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 156/306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:45 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1513 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:46.015717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:46.016425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:46.022737 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.023300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.023939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.024918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.025703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.026278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.107845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:46.109016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:46.118860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.119371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.120011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.120911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.121413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.122050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.179224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:46.187864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-80529566-ddf1-4f50-beb3-b4c23a6738a0 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.175927 Oct 27 01:25:46.188431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:46 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:46.265005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:46.273753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3e7f92d3-c1e5-4974-bec7-ad9e73ff14db tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.169847 Oct 27 01:25:46.274603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 157/308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:46 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:46.648270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:46.649365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:46.657208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.657696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.658135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.658836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:46.659296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:46.659720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:46.725365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:46.735558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3e9788d2-caf2-49a0-a0f6-dc49f3b0fe4c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1346 microversion: 2.1 time: 0.093112 Oct 27 01:25:46.736128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 152/309] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:46 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:47.213766 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:47.214405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:47.221710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.222194 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.222725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.223563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.224044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.224475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.300086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:47.302347 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:47.313777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.314272 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.315161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.316040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.317052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.317606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.395527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:47.404786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-22784cf3-90d7-4105-8751-5cd3f26b6351 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.195287 Oct 27 01:25:47.406258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 158/310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:47 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:47.472778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:47.481976 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6d94c577-7c8f-44b7-b325-53914a20b409 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.187625 Oct 27 01:25:47.482738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 153/311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:47 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:47.760127 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:47.761291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:47.767973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.768464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.769043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.770430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:47.770883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:47.771434 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:47.846372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:47.855549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8f53410e-e02b-4115-95ad-15dbf0d53d62 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1346 microversion: 2.1 time: 0.100677 Oct 27 01:25:47.868954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 159/312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:47 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:48.428704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:48.429513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:48.436497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.437077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.437657 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.438414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.439094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.440022 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.444893 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:48.507259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:48.508598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:48.516638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.517974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.518579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.519297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.519813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.520586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.637983 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:48.646513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-59edad13-eb8d-4da4-97ca-d11722de9397 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.222337 Oct 27 01:25:48.647127 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:48 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:48.696281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:48.704047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7b888d7f-ae9f-4acd-8779-4494def68b92 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.201982 Oct 27 01:25:48.704604 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 160/314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:48 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:48.879784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:48.880389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:48.886482 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.886990 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.887424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.888115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:48.888561 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:48.889003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:48.950196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:48.959080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c63a2e9d-4638-4cfd-b4fc-cc981e5335c0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1346 microversion: 2.1 time: 0.083250 Oct 27 01:25:48.959643 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 155/315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:48 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:49.671101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:49.671728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:49.679340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.679817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.680499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:49.681224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.681667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.682083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:49.727548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:49.728150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:49.734024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.734500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.734957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:49.735644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.736087 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.736506 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:49.852622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:49.860218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-adb248f7-a72e-4e2d-81fc-224ed264c839 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.192977 Oct 27 01:25:49.860780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:49 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:49.895251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:49.902878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-47c6af9a-9510-4fd5-af9d-02692506bf37 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.179266 Oct 27 01:25:49.903436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 156/317] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:49 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:49.981980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:49.982623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:49.989191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.989754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.990184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:49.990864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:49.991311 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:49.991728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:50.052603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:50.060913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b5e779ec-2f9b-4c82-9216-3a685b9c2965 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1346 microversion: 2.1 time: 0.082775 Oct 27 01:25:50.061494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 162/318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:49 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:50.883968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:50.884577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:50.890485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:50.890968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:50.891403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:50.892141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:50.892542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:50.892967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:50.924886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:50.925515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:50.932359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:50.932837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:50.933300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:50.934165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:50.934617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:50.935041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:51.074709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:51.084098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4a783e6e-522e-46b7-8db2-46cefab03e93 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.203846 Oct 27 01:25:51.084681 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:50 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:51.089248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:51.089855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:51.095592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:51.096261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:51.096853 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:51.097863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:51.098572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:51.099157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:51.110027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:51.117826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-76ede3c0-18c0-4d64-8071-e07128cef337 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.196678 Oct 27 01:25:51.118386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:50 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:51.164329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:51.172550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-de1d4ad4-3e9f-4c3c-b4cb-c14f977c858d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1346 microversion: 2.1 time: 0.086885 Oct 27 01:25:51.173139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 158/321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:51 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:51.508145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123f8483-ead8-4696-bad4-a0144565fa6d", "name": "network-vif-plugged", "status": "completed", "tag": "ef4dbd6f-2b59-4996-ac64-47b97d0e16c7"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:51.518016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:51.518501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:51.518928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:51.530072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] Creating event network-vif-plugged:ef4dbd6f-2b59-4996-ac64-47b97d0e16c7 for instance 123f8483-ead8-4696-bad4-a0144565fa6d on hv-cinder-81558 Oct 27 01:25:51.535597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-bd33a1c1-fe02-4869-817c-27089d225332 req-7cc6631a-ff2f-418c-824b-1625ebc6cc0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Oct 27 01:25:51.536417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 164/322] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:25:52.106959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:52.107574 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:52.114070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.114562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.114997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.115691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.116145 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.116589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.142156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:52.142886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:52.148955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.149465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.149899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.150581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.151029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.151446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.533303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:52.541367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-df49d66e-523d-400f-8ec4-fd1cfea9964b tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.438126 Oct 27 01:25:52.541946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 159/323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:52 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:52.545481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:52.546543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:52.546984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:52.553582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.554078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.554515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.554633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-18ec6826-a495-47e0-8a0d-5b278132c5c8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.416857 Oct 27 01:25:52.555477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.556155 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.556543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.557235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 165/324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:52 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:52.587557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:52.588041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:52.588473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:52.588906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:52.638856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:52.648470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4d72b4cd-da66-4c2b-994f-5331fec2fe9b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.105583 Oct 27 01:25:52.649027 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 160/325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:52 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:52.849958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1064986686", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "networks": [{"uuid": "24be29c8-49a2-4c9f-8d22-b7f159d95f6b"}]}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:25:52.902649 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] validate_networks() for [('24be29c8-49a2-4c9f-8d22-b7f159d95f6b', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:25:53.249666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:25:53.250234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:25:53.250543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:25:53.250957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:25:53.251366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:25:53.265677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.266209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.266776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.267546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.268039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.268478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.286772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Getting quotas for project a816bcfd87b34071a24b948c351811c4. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:25:53.290952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Getting quotas for user 1505f37c15c0461a912d59172ebdf94a and project a816bcfd87b34071a24b948c351811c4. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:25:53.303265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:25:53.305967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:25:53.355646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8ecb0d98-4c66-4ef8-8335-8b681d5e27b7 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510529 Oct 27 01:25:53.356665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 166/326] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:25:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:25:53.368728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cccba965-107c-47bb-a710-9cc141fd4039 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:53.369375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cccba965-107c-47bb-a710-9cc141fd4039 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:53.448039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cccba965-107c-47bb-a710-9cc141fd4039 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:53.455925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cccba965-107c-47bb-a710-9cc141fd4039 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1214 microversion: 2.1 time: 0.091628 Oct 27 01:25:53.456482 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 161/327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:53 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:53.566169 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:53.566984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:53.572949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.573518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.574067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.574765 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.575283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.575769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.579527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:53.580192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:53.588163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.588854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.589322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.590021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.590629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.591217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.783437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:53.793422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-eb390abc-8c33-4521-bf8b-6c7a374b5c80 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.231057 Oct 27 01:25:53.793933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 167/328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:53 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:53.800059 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:53.806670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:53.809683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:53.813534 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-51adc8c3-90ba-499f-86bf-93df00b6ffd7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.237910 Oct 27 01:25:53.829466 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 162/329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:53 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:53.835829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.836319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.836754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.837483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.837931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.838348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.873470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:53.873941 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:53.874378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:53.874816 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:53.917827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:53.927103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2ee80e4b-f23f-4ece-a14e-741edc29fb82 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.132069 Oct 27 01:25:53.927675 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:53 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:54.479527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:54.480137 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:54.486029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.486516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.487001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:54.487694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.488636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.489135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:54.549126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:54.557730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7cddb0a1-aa3e-4b67-9b58-70c43eeb17ea tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1218 microversion: 2.1 time: 0.082113 Oct 27 01:25:54.558285 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 163/331] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:54 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:54.820966 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:54.821603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:54.838952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:54.839560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:54.844403 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.846304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.849864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:54.851337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.851989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.852567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:54.856942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.857656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.858257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:54.862594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:54.863894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:54.865177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.113679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:55.121448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e2451475-6bd9-4c12-8815-d32d0379ebca tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1315 microversion: 2.1 time: 0.304985 Oct 27 01:25:55.122014 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 169/332] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:54 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:55.124541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:55.126965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:55.127742 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:55.134264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:55.134975 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:55.135591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.136500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:55.137143 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:55.137802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.139062 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-966f8200-8a31-42c2-830a-b3053a686f42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.303770 Oct 27 01:25:55.139833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 164/333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:54 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:55.153436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:55.170540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:55.171022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:55.171459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.171911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:55.240149 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:55.248407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-18edf3a3-b881-4d2a-b566-bdaf9ace63be tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.124987 Oct 27 01:25:55.249109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 170/334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:55 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:55.580890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:55.581517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:55.589424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:55.589901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:55.590504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.591196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:55.598973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:55.599418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:55.672441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:55.684775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e75332e3-4c3d-4899-b2f4-ca749ffa203f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.107645 Oct 27 01:25:55.700412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 165/335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:55 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:56.144060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.145190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.151506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.151982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.152413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.153116 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.153563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.153985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.163945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.165671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.172910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.173531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.174103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.174865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.175874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.176400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.358589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:56.364766 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:56.366992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5a7d0211-2931-4842-8765-6f306bc4ebc9 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1463 microversion: 2.1 time: 0.226578 Oct 27 01:25:56.367775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 171/336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:56 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1463 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:56.373453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.374096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.377164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-aef8d687-9453-43d5-b705-53109b9d8075 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.217123 Oct 27 01:25:56.377818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 166/337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:56 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:56.394054 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.394788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.395174 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.395911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.396365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.396790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.422206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.422698 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.424502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:56.434842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.435627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.436389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.437568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.438283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.439277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.441734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.442478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.442793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.443313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:56.475099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:25:56.489991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:56.498778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9b57c06e-af8f-4b81-bd9a-a10e86a14980 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.129831 Oct 27 01:25:56.499472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 172/338] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:56 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:56.562000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d2490bd3-775a-4115-8258-c7b26a56a395 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 204 len: 0 microversion: 2.1 time: 0.143370 Oct 27 01:25:56.565579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 167/339] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:25:56 2022] DELETE /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:25:56.571082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.571818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.577833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.578400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.578917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.579679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.580141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.580567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.710751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:56.711445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:56.717497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.718098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.718671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.719402 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:56.719894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:56.720306 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:56.764198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:56.772499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f06176c2-8836-4ff4-8576-839a9a7f21f4 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.205346 Oct 27 01:25:56.773407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 173/340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:56 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:56.802495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:56.810602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-512d0258-f632-4bd3-84a2-c9364dd2b74d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.105571 Oct 27 01:25:56.811347 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 168/341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:56 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:57.400789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:57.401528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:57.408238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.408770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.409259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.409958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.410457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.410926 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.523026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:57.523722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:57.530426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.531004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.531556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.532389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.532945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.533378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.552244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:57.561313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d9e525e3-a486-488a-b170-641c730787d4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.164247 Oct 27 01:25:57.562375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 174/342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:57 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:57.572217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.572777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.573310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.573836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:57.576659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:57.615762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:57.624822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ee80c251-6bb4-4c0d-8f8a-7301202113a0 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.106441 Oct 27 01:25:57.625412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 169/343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:57 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:57.796947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:57.797594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:57.804739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.805608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.806049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.806952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.807572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.808068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.835107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:57.835721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:57.842009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.842667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.842910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.843772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:57.844505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:57.845283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:57.926616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:57.936584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-73f4db1e-5b5e-4f49-ae6c-411a4fadb3b0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.105609 Oct 27 01:25:57.937368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 170/344] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:57 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:57.969800 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:57.977623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c535b2d6-2a92-4b42-9d93-f374faecac3d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.184510 Oct 27 01:25:57.978183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 175/345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:57 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:58.587843 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:58.588750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:58.596090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.596773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.597408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.598436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.598967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.599640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.648869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:58.650719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:58.658064 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.658755 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.659467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.660834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.661615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.662197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.696517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:25:58.701884 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.702825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.703724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.704336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:58.767433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:58.785115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c261f528-ebfa-4cae-a0c7-97fa0c2b786d tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.140808 Oct 27 01:25:58.786690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 176/346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:58 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:58.792005 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:58.801566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0d385bf3-43a9-46ca-89d0-7f928f90b8c0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.218178 Oct 27 01:25:58.814120 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 171/347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:58 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:58.959453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:58.960410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:58.966168 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.966650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.967075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:58.967976 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:58.968396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:58.968988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.001607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:59.002207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:59.013783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.014483 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.015081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.015932 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.016528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.017112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.043737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:59.051730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-251f25ed-e72b-4175-b809-dae6f266fa61 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.096148 Oct 27 01:25:59.052302 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 177/348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:58 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:25:59.167450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:25:59.178443 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4079eaf8-5491-41f6-8c10-d4355b453d44 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.180525 Oct 27 01:25:59.179627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 172/349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:58 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:25:59.814830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:59.814830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:59.818626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.819183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.820023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.820367 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.820822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.821398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.833171 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:25:59.842216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:25:59.856189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.856422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.856672 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.857304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.857427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.857803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:25:59.858267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:25:59.860510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:25:59.861217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:25:59.861860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:00.003178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:00.017769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6e41b10c-6a7d-4556-81d5-b6544e24c303 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.211487 Oct 27 01:26:00.020918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 178/350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:59 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:00.076498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:00.077295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:00.088209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:00.089170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:00.092041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:00.092905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:00.093406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:00.093860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:00.201144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:00.218155 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f0a1b67c-49f3-411b-9e28-55815dc538dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1521 microversion: 2.1 time: 0.391852 Oct 27 01:26:00.219324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 173/351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:25:59 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:00.241400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:00.242034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:00.258490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:00.259468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:00.260086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:00.260813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:00.261295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:00.262028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:00.263947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:00.272694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e3ee6f96-1bed-49e8-afde-24fe4b914bf3 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.200069 Oct 27 01:26:00.286095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 179/352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:00 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:00.438980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:00.458442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-044763cf-5dfc-4909-9380-96af95cb2366 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.236236 Oct 27 01:26:00.459577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 174/353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:00 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:01.045716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:01.047138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:01.056045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.056719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.057382 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.058536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.059227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.059807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.104069 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.105580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.106846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.108092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:26:01.165392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:01.177828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6f431bb0-efb3-47f1-9b05-b1c52f973a69 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.136019 Oct 27 01:26:01.178710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 180/354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:01 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:01.245980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:01.246934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:01.260115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.262701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.263238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.264307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.265024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.266927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.311132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:01.311949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:01.321788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.322746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.323673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.325512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.326256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.328842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.420653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:01.436944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-96798868-de9a-4295-b323-43083bc51aab tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.131242 Oct 27 01:26:01.439020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 181/355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:01 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:01.487908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:01.489876 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:01.497912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.498663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.500349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.502371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.503057 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.503782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.563998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:01.574537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bbffc531-5abc-4703-be58-d7fbc875eebf tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1501 microversion: 2.1 time: 0.335726 Oct 27 01:26:01.575773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 175/356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:01 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:01.598924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:01.599788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:01.610155 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.611416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.612119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.613673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:01.614341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:01.614989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:01.685139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:01.694072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-206019d9-9287-4456-92fa-d743e42c914d tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.214139 Oct 27 01:26:01.694662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 182/357] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:01 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:01.845888 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:01.856454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0b02cd3b-37fa-4609-ad52-d799038ba916 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1516 microversion: 2.1 time: 0.262730 Oct 27 01:26:01.857648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 176/358] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:01 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:02.202610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:02.203142 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:02.209953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.210437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.210877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.211589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.216275 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.216727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.282608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.284430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.286417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.288508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lazy-loading 'fault' on Instance uuid 56da46ce-164d-41a9-96f0-1e23257f43f1 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:26:02.384412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68909cf0c5bf4875927b30d9a6ce8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72a2266373f44749fa0d3bbd3bb68cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:02.397664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9043c3d4-5003-4e81-8bea-0dfccfd5f4a2 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 200 len: 1351 microversion: 2.1 time: 0.199461 Oct 27 01:26:02.405372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:02 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:02.465801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:02.466499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:02.480372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.480856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.481324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.482035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.482484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.482903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.571896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:02.583112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-35e185f1-9a6f-438d-bdb2-38ee7a3320c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1210 microversion: 2.1 time: 0.121083 Oct 27 01:26:02.584214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:02 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:02.721667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:02.723331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:02.740595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.742708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.744424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:02.747547 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:02.749155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:02.750286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.023885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:03.034944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1ee30b61-a15a-451d-9e3c-0411843b4d1f tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1469 microversion: 2.1 time: 0.318032 Oct 27 01:26:03.054070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 184/361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:02 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:03.306902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123f8483-ead8-4696-bad4-a0144565fa6d", "name": "network-vif-deleted", "tag": "ef4dbd6f-2b59-4996-ac64-47b97d0e16c7"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:03.325353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.325886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.326213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.340571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] Creating event network-vif-deleted:ef4dbd6f-2b59-4996-ac64-47b97d0e16c7 for instance 123f8483-ead8-4696-bad4-a0144565fa6d on hv-cinder-81558 Oct 27 01:26:03.345863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-25a0e067-3ed5-4962-aaee-dfccd60db92e req-a158cfc5-3ec9-432f-89c0-ef3a71843e2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042945 Oct 27 01:26:03.346797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 178/362] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:03.423238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:03.424368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:03.430743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:03.431356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:03.451682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.452804 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.453480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.454735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.455395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.455909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.460934 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:03.478369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] HTTP exception thrown: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Request method failure captured: Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 HTTP/1.1 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd2zoXg4Wti1968xovhekOlD8gLp_JGujfea6NRvzOORDgIznJllxYZRaJ4poPlCJsZ8bBPmC_qQlh8zboBERyYGGl4J7Hi5G5ARCXZenM3tRgC1db_OxZmPGz6aegr2kRoYdKRc3kag5g0eevm2dKODFgZwFT-FmXCJmgZjlSTpgu8 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:26:03.483697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c72a2266373f44749fa0d3bbd3bb68cd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 68909cf0c5bf4875927b30d9a6ce8cd9 Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.485325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '56da46ce-164d-41a9-96f0-1e23257f43f1'} Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:03.486221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.487998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.489144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Returning 404 to user: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:03.489954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-faa11583-4b25-4dc1-918a-a282e6cbdf3c tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 404 len: 111 microversion: 2.1 time: 0.070892 Oct 27 01:26:03.490613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 185/363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:03 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:03.500068 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:03.506420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:03.509536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:03.521264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.522148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.522803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.523745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.524404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.525221 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.586764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lazy-loading 'flavor' on Instance uuid f08e412b-ed93-474b-9f25-0c643550c84c {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:26:03.606551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:03.607638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:03.617810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.618813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.619523 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.620323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.621044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.626031 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.776045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ea0296ae-7940-4f39-84c9-43bde3e72624 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/action" status: 200 len: 32 microversion: 2.1 time: 0.276525 Oct 27 01:26:03.776722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 179/364] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:26:03 2022] POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:26:03.797280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:03.807365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:03.822603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:03.837662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.838151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.838600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.841499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1271ebb8-7720-495c-8862-8b430f891ba4 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1274 microversion: 2.1 time: 0.236182 Oct 27 01:26:03.841656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.843283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 186/365] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:03 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:03.843732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.844624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.861724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:03.875804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] HTTP exception thrown: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.880462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Request method failure captured: Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1/os-volume_attachments HTTP/1.1 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd2zoXg4Wti1968xovhekOlD8gLp_JGujfea6NRvzOORDgIznJllxYZRaJ4poPlCJsZ8bBPmC_qQlh8zboBERyYGGl4J7Hi5G5ARCXZenM3tRgC1db_OxZmPGz6aegr2kRoYdKRc3kag5g0eevm2dKODFgZwFT-FmXCJmgZjlSTpgu8 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:26:03.882029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c72a2266373f44749fa0d3bbd3bb68cd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 68909cf0c5bf4875927b30d9a6ce8cd9 Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.884298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'server_id': '56da46ce-164d-41a9-96f0-1e23257f43f1'} Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:03.885316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:03.886791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:03.889593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Returning 404 to user: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:03.891563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-143f5de2-d7ae-4b22-95bf-2de3b47141f4 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103921 Oct 27 01:26:03.892614 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 180/366] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:26:03 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1/os-volume_attachments => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:03.910983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.914136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.914968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:03.915951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:03.917624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:03.929563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:04.059899 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:04.060685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:04.074062 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:04.075701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:04.076315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:04.077970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:04.078837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:04.080048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:04.143094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:04.143594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:04.144735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:04.145279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lazy-loading 'fault' on Instance uuid 123f8483-ead8-4696-bad4-a0144565fa6d {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:26:04.207105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ac8bc3fb2734e979ae50aff1a6e905e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f135389d386e43d58581df01f80c083c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:04.214243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:04.215374 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2a287355-d59e-4cd5-8ff6-d0f5aacc1074 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 200 len: 1305 microversion: 2.1 time: 0.159649 Oct 27 01:26:04.215952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 181/367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:04 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:04.246038 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-208b289a-8288-4e90-8796-d5a2ebbbf50a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.399919 Oct 27 01:26:04.249692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 187/368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:03 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:04.869901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:04.870590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:04.877240 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:04.881813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:04.889834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:04.890633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:04.891105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:04.891702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.008907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:05.017092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a3286964-1a39-4978-9038-6cb48341a519 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1272 microversion: 2.1 time: 0.151036 Oct 27 01:26:05.021738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 182/369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:04 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:05.224407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:05.225441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:05.233293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.239131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.244443 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:05.245312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] [instance: 123f8483-ead8-4696-bad4-a0144565fa6d] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:05.249909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.254780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.256553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.259279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.259975 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.261415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.265836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.267085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.267698 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.268311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.290812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] HTTP exception thrown: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Request method failure captured: Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 HTTP/1.1 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd2zoXg4Wti1968xovhekOlD8gLp_JGujfea6NRvzOORDgIznJllxYZRaJ4poPlCJsZ8bBPmC_qQlh8zboBERyYGGl4J7Hi5G5ARCXZenM3tRgC1db_OxZmPGz6aegr2kRoYdKRc3kag5g0eevm2dKODFgZwFT-FmXCJmgZjlSTpgu8 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:26:05.296309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c72a2266373f44749fa0d3bbd3bb68cd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 68909cf0c5bf4875927b30d9a6ce8cd9 Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.297785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '56da46ce-164d-41a9-96f0-1e23257f43f1'} Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:05.298600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.299910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.302851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Returning 404 to user: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:05.303936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0bce0aac-bc5e-432c-ae83-531d235dc02b tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "DELETE /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 404 len: 111 microversion: 2.1 time: 0.084761 Oct 27 01:26:05.304711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 188/370] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:26:05 2022] DELETE /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:05.310053 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:05.310967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:05.315518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] HTTP exception thrown: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. Oct 27 01:26:05.319345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.320107 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.320770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.321726 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.322408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.323055 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Request method failure captured: Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d HTTP/1.1 Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd4DfCWrieILp5bZ2IX_ApILKQgTeFxzfSmUqdTkbNnTw4ofcMXnItOxOpG9HSwEvsw2S4YGao_Aex9nFzhy9KzvzhTWMxZBLoU2q7BSpv6Ja5L3i_764TC505vA2QGaICkRrnNG5g3DR53d1NrrQ5hN_TqPEiV5b06PZeOxBdOCOFI Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: f135389d386e43d58581df01f80c083c Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-VolumesNegativeTest-1687637986 Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:26:05.324526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f135389d386e43d58581df01f80c083c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f135389d386e43d58581df01f80c083c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f135389d386e43d58581df01f80c083c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f135389d386e43d58581df01f80c083c", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-VolumesNegativeTest-1687637986 Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: f135389d386e43d58581df01f80c083c Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-VolumesNegativeTest-1687637986 Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-VolumesNegativeTest-1687637986-project Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 2ac8bc3fb2734e979ae50aff1a6e905e Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-VolumesNegativeTest-1687637986-project Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. Oct 27 01:26:05.326007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '123f8483-ead8-4696-bad4-a0144565fa6d'} Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:05.326722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. Oct 27 01:26:05.327787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.328817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] Returning 404 to user: Instance 123f8483-ead8-4696-bad4-a0144565fa6d could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:05.328817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2901e300-16ad-4af6-a18a-2a45f2ff48b5 tempest-VolumesNegativeTest-1687637986 tempest-VolumesNegativeTest-1687637986-project] 10.222.0.42 "GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d" status: 404 len: 111 microversion: 2.1 time: 0.087004 Oct 27 01:26:05.332180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 183/371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:05 2022] GET /compute/v2.1/servers/123f8483-ead8-4696-bad4-a0144565fa6d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:05.363014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:05.364090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] [instance: 56da46ce-164d-41a9-96f0-1e23257f43f1] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:05.383597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.384150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.390066 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.390877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:05.392361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:05.394952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:05.439053 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] HTTP exception thrown: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Request method failure captured: Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 HTTP/1.1 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd2zoXg4Wti1968xovhekOlD8gLp_JGujfea6NRvzOORDgIznJllxYZRaJ4poPlCJsZ8bBPmC_qQlh8zboBERyYGGl4J7Hi5G5ARCXZenM3tRgC1db_OxZmPGz6aegr2kRoYdKRc3kag5g0eevm2dKODFgZwFT-FmXCJmgZjlSTpgu8 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:26:05.447774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c72a2266373f44749fa0d3bbd3bb68cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c72a2266373f44749fa0d3bbd3bb68cd", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: c72a2266373f44749fa0d3bbd3bb68cd Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-DeleteServersTestJSON-412854064 Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 68909cf0c5bf4875927b30d9a6ce8cd9 Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-DeleteServersTestJSON-412854064-project Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.450728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '56da46ce-164d-41a9-96f0-1e23257f43f1'} Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:05.451762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. Oct 27 01:26:05.453477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:05.455985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] Returning 404 to user: Instance 56da46ce-164d-41a9-96f0-1e23257f43f1 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:05.460844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-32eb2897-047f-4508-a496-ab8ef8fe4d89 tempest-DeleteServersTestJSON-412854064 tempest-DeleteServersTestJSON-412854064-project] 10.222.0.42 "GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1" status: 404 len: 111 microversion: 2.1 time: 0.124461 Oct 27 01:26:05.462905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 184/372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:05 2022] GET /compute/v2.1/servers/56da46ce-164d-41a9-96f0-1e23257f43f1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:05.774839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:05.788533 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3131d490-4da9-4b38-a6ea-315cffaab1ee tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.482242 Oct 27 01:26:05.790788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 189/373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:05 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:06.044426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:06.045041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:06.054559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:06.055790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:06.056626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:06.057814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:06.058645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:06.059329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:06.805572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:06.819894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:06.821084 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:06.832601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-252d2af6-9139-4fc5-9eec-f756f28c3a28 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.790996 Oct 27 01:26:06.835286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 185/374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:06 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:06.846251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:06.846251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:06.846251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:06.846251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:06.847518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:06.847518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:07.700636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:07.715897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ca563a56-40a1-47fc-adc4-df276e7ddec4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.901946 Oct 27 01:26:07.716734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 190/375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:06 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:07.854381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf861c46-754d-4cac-84ce-bc96e2d30d29", "tag": "eb8780e9-ea35-4a35-b3fe-dd15ac3322d4"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:07.861577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:07.863564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:07.874942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:07.875909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:07.877095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:07.877802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:07.878424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:07.881095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:07.881641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:07.884920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:07.888186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:07.899741 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] Creating event network-changed:eb8780e9-ea35-4a35-b3fe-dd15ac3322d4 for instance cf861c46-754d-4cac-84ce-bc96e2d30d29 on hv-cinder-81558 Oct 27 01:26:07.905669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-c2686b46-f689-4da5-9cee-56a55298d691 req-d4067d90-dcc8-4873-bf04-1d8560836627 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056832 Oct 27 01:26:07.907168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 186/376] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:08.481528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:08.502762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-25df3110-d639-4bee-b20b-f88a995709a5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.645516 Oct 27 01:26:08.508105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 191/377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:07 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:08.745940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:08.746881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:08.770654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:08.772515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:08.773824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:08.777629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:08.778447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:08.783137 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:08.796919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:09.204919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:09.217686 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fcf28fc3-061c-4b7f-a19c-74f6884b39b9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.475056 Oct 27 01:26:09.234165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 187/378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:08 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:09.535859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:09.536467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:09.554248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:09.554248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:09.554248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:09.554248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:09.554572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:09.554572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:09.952616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:09.968023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5cccbdbc-9f59-4930-ae94-571b53b2e24b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.436124 Oct 27 01:26:09.968784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 192/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:09 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:10.257079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:10.260045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:10.277723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:10.279142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:10.280119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:10.281622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:10.283762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:10.285355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:10.586886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:10.607424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-59bc2746-e35b-428d-bac3-b3bbae1ff403 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.357911 Oct 27 01:26:10.608388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 188/380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:10 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:10.992773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:10.993664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:11.007301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:11.007972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:11.013634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:11.014407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:11.014868 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:11.020590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:11.413557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:11.444073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8b82e690-70c8-4865-b0ac-1637bcdfdc56 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.448475 Oct 27 01:26:11.448371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 193/381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:10 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:11.634278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:11.635004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:11.645855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:11.652933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:11.654270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:11.656652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:11.657544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:11.658393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:12.266845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:12.279744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-717032a3-c81f-4b67-beb7-a328d1be3174 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.648717 Oct 27 01:26:12.280964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 189/382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:11 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:12.481717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:12.483096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:12.520524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:12.523647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:12.524340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:12.526533 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:12.528180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:12.528831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:13.117753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:13.127119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c65d9029-ce44-4779-8570-184bacc0f084 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.659537 Oct 27 01:26:13.142931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 194/383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:12 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:13.304503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:13.305368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:13.311553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:13.312239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:13.312672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:13.313397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:13.313880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:13.314304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:13.784251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:13.786267 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1de72802-716c-44b7-aba1-31e209dc41c9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Action: 'create', calling method: .version_select at 0x7f6c131c2430>, body: {"keypair": {"name": "tempest-TestShelveInstance-747643760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/Sut9PcuwVf6os4IEdreXW54faA/5kELCdgJglGLXtNF2cZ/AU0JYWKU7SVk+MBET5NY1iKDm/n0rxC9L+oLXJ5HTVRLDizRO2QCQs28EGZE+pCU7enMpJFDkbG31/+g=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:13.795563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a7cb17ac-e2b1-43a3-bed1-117c25ad515c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.494806 Oct 27 01:26:13.815799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 190/384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:13 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:13.824090 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-1de72802-716c-44b7-aba1-31e209dc41c9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Getting quotas for project 40ecdf4e71844f7f9e3da7f59659b605. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:26:13.833938 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-1de72802-716c-44b7-aba1-31e209dc41c9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Getting quotas for user 181df03f4bba4f96afc3c888b3ca9b4d and project 40ecdf4e71844f7f9e3da7f59659b605. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:26:13.868220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1de72802-716c-44b7-aba1-31e209dc41c9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.315029 Oct 27 01:26:13.868969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 195/385] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:26:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:26:14.157429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:14.158362 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:14.168006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:14.171042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:14.171620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:14.172979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:14.176846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:14.178076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:14.701337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:14.720934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6be1fad1-2de4-48d6-abfc-72eb9885a91e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.572132 Oct 27 01:26:14.721863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 191/386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:14 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:14.824273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:14.824880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:14.843928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:14.844535 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:14.844855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:14.845595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:14.846041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:14.846464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:15.262973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:15.275423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-30a716f4-30d0-406e-856f-d9040c250adb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.456501 Oct 27 01:26:15.276010 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 196/387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:14 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:15.748530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:15.749913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:15.763439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:15.764895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:15.767579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:15.769264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:15.788258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:15.790776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:16.256512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:16.269825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e3581a68-d5a2-4f5b-b28f-7b244d63d069 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.524506 Oct 27 01:26:16.271248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 192/388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:15 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:16.304525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:16.306650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:16.317235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:16.318791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:16.319397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:16.320260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:16.321027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:16.321624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:16.674301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:16.687143 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1020f745-c456-4a17-ae65-9925a61aadbe tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.387563 Oct 27 01:26:16.688356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 197/389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:16 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:17.294206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:17.294974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:17.302280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:17.303220 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:17.303778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:17.305442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:17.305903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:17.306658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:17.467249 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:17.476055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-479e6964-1a2c-464d-bc11-910c7e822015 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.185916 Oct 27 01:26:17.481576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 193/390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:17 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:17.716520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:17.717398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:17.724697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:17.725210 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:17.725907 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:17.726684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:17.727209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:17.727730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.034877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:18.045921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-03ad84ac-4c90-418b-96f9-411e7ba136f5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1502 microversion: 2.1 time: 0.335672 Oct 27 01:26:18.048962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 198/391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:17 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1502 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:18.076246 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cb10b50-a4d7-470b-922d-d484322dac41"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:18.081589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:18.090783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.092067 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.092709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.093853 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.094411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.094992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.127609 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] HTTP exception thrown: Cannot 'attach_volume' instance f08e412b-ed93-474b-9f25-0c643550c84c while it is in vm_state rescued Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Request method failure captured: Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/os-volume_attachments HTTP/1.1 Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 74 Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd22pI394q_8Rabd2tXO0hmcv8ZzBb7T3cMmcksE1CVm9yvjG81r-Lk5wrkUjGyBWCg_S-mnDQuGGWvOk005h-azH9qWW2zIZgsoDYXgBrFtK1gEFAfwqzVOSyLxpOGcRdMZXnIYZPTtisI6dVx5TF2pwWLH_pzlFhjr8oHOb__x3ls Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:26:18.131527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eefe01b108148bab60d4de13be0405d", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: d311fc1f82124819b509f766fa432e2c Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {"volumeAttachment": {"volumeId": "5cb10b50-a4d7-470b-922d-d484322dac41"}} Oct 27 01:26:18.132818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Cannot 'attach_volume' instance f08e412b-ed93-474b-9f25-0c643550c84c while it is in vm_state rescued Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'server_id': 'f08e412b-ed93-474b-9f25-0c643550c84c', 'body': {'volumeAttachment': {'volumeId': '5cb10b50-a4d7-470b-922d-d484322dac41'}}} Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f08e412b-ed93-474b-9f25-0c643550c84c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:18.133966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f08e412b-ed93-474b-9f25-0c643550c84c while it is in vm_state rescued Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:18.135193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:18.136243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:18.136243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:18.136243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f08e412b-ed93-474b-9f25-0c643550c84c while it is in vm_state rescued Oct 27 01:26:18.136243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:26:18.138024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Returning 409 to user: Cannot 'attach_volume' instance f08e412b-ed93-474b-9f25-0c643550c84c while it is in vm_state rescued {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:18.139355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6c9b3ffd-e4e2-4367-ad64-ffeba2c13554 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071322 Oct 27 01:26:18.140658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 194/392] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:26:18 2022] POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 01:26:18.151187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:18.152032 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:18.158890 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.160108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.160791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.161708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.162828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.163474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.239091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf861c46-754d-4cac-84ce-bc96e2d30d29", "name": "network-vif-plugged", "status": "completed", "tag": "eb8780e9-ea35-4a35-b3fe-dd15ac3322d4"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:18.250528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.254284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.255752 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.270609 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] Creating event network-vif-plugged:eb8780e9-ea35-4a35-b3fe-dd15ac3322d4 for instance cf861c46-754d-4cac-84ce-bc96e2d30d29 on hv-cinder-81558 Oct 27 01:26:18.278494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-c9645200-31a7-4c1c-839e-27e8588f9b0f req-3e85dc1f-0d71-4cb5-b751-fbde0796a49a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043042 Oct 27 01:26:18.279498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 195/393] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:18.307458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a5acc928-bf31-4582-9309-46ac34552360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/action" status: 202 len: 0 microversion: 2.1 time: 0.139428 Oct 27 01:26:18.310292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 199/394] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:26:18 2022] POST /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:26:18.318131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:18.320473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:18.333419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.333900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.334511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.335875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.337255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.337837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.509006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:18.510137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:18.517261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.517972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.518673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.519573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:18.520185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:18.520808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:18.531298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:18.544600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b031d168-8144-4945-ba9f-b60ebf922cf2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.230752 Oct 27 01:26:18.556536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 196/395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:18 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:18.695457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:18.715741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3530216f-754c-4572-b67e-029bb696e39c tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.215287 Oct 27 01:26:18.716400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 200/396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:18 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:19.573099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:19.573707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:19.579728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:19.580194 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:19.580629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:19.582165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:19.582635 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:19.583065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:19.742791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:19.744232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:19.752098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:19.752475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:19.753900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:19.754943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:19.755543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:19.756197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:19.769234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:19.782003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-428d6b96-a6a3-40a4-8d1c-eab39be70395 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.212358 Oct 27 01:26:19.783295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 197/397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:19 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:19.978055 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:19.988859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-34babea2-1165-49bb-ad39-3f1ca634c99e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.252172 Oct 27 01:26:19.989749 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 201/398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:19 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:20.827326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:20.827931 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:20.835920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:20.836405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:20.837176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:20.838153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:20.839124 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:20.839252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:20.997654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:21.007157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-564e73ea-ae53-49f9-a5ef-92c1a6c8fcf9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.184891 Oct 27 01:26:21.007789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 198/399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:20 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:21.025839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:21.026516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:21.034709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:21.035191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:21.035626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:21.036314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:21.036762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:21.037207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:21.196326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:21.204325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b0af8819-150e-413f-bc4c-b4b5d283d582 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.190014 Oct 27 01:26:21.204995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 202/400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:21 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:22.030917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:22.031579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:22.037581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:22.038064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:22.038494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:22.039189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:22.039638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:22.040060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:22.185934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:22.194846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f0a215f6-592e-4b2d-b2ba-e24ca7c7d679 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.167761 Oct 27 01:26:22.195418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 199/401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:22 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:22.231481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:22.232082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:22.239215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:22.239727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:22.240145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:22.240832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:22.241395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:22.241822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:22.244557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:22.374687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:22.382991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-82d1b35c-eebf-4c83-ac12-1c8ad7faec95 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.155320 Oct 27 01:26:22.383622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 203/402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:22 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:23.217405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:23.218015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:23.224624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:23.225331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:23.225772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:23.226457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:23.226911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:23.227338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:23.406336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:23.406874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:23.413632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:23.420141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:23.420664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:23.421163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:23.421870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:23.422353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:23.422912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:23.428662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-832f0193-7721-4bcf-b792-a1eb073eca99 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.214776 Oct 27 01:26:23.429464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 200/403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:23 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:23.655405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:23.664061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-74a3fd19-8118-4b54-967f-6ed2b8e0a9a6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.261788 Oct 27 01:26:23.664558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 204/404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:23 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:24.457229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:24.457923 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:24.465675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:24.466492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:24.467876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:24.468817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:24.470620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:24.471422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:24.638573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:24.645311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9fa02ecc-a580-4847-be46-0a85cd4a481e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.195589 Oct 27 01:26:24.661719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 201/405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:24 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:24.689271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:24.689882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:24.697104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:24.700419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:24.701604 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:24.702756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:24.703651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:24.704281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:24.704920 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:24.879599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:24.888728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e4dc2b0f-2f5a-465f-9a9f-206d7a303b2e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1314 microversion: 2.1 time: 0.204608 Oct 27 01:26:24.889666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 205/406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:24 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:25.668750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:25.669432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:25.675901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:25.676382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:25.676814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:25.677530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:25.678176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:25.678889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:25.829735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:25.840458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a0e6d018-bbc8-4aaf-aaa6-9ea6bee25e5b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.175435 Oct 27 01:26:25.841231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 202/407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:25 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:25.917295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:25.917295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:25.919576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:25.920056 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:25.920490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:25.921229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:25.921683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:25.922114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.060170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:26.069201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e87ba3de-1d41-4d4c-9631-de2843224d50 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1498 microversion: 2.1 time: 0.161163 Oct 27 01:26:26.069792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 206/408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:25 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:26.685293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:26.686434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:26.689665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:26.694292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.694859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.695367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.696148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.696675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.697207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.739909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:26:26.781679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:26.832233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d96edadc-25d7-47a3-adf5-406295d413f6 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 204 len: 0 microversion: 2.1 time: 0.150487 Oct 27 01:26:26.833358 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 203/409] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:26:26 2022] DELETE /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:26:26.842433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:26.843422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:26.866909 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:26.867936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.868354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:26.868476 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.868854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.869594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.870045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.873422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.881496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.883050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.885360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:26.886715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:26.888340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:26.888975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:27.119072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:27.130937 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f3ed9cad-f715-4590-a9f1-2d4ab160bd80 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.269673 Oct 27 01:26:27.131762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 204/410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:26 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:27.131952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:27.142201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-368c649d-9725-4337-b57e-d9057a6be9e0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1504 microversion: 2.1 time: 0.303164 Oct 27 01:26:27.143479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 207/411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:26 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:28.161533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:28.164403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:28.168451 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:28.169151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:28.171610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:28.172321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:28.173007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:28.173957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:28.175496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:28.176184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:28.193739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:28.194292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:28.194664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:28.196718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:28.198549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:28.199837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:28.475320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:28.485443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-07ab6012-f1e3-4854-856c-e8ba2885ac88 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1504 microversion: 2.1 time: 0.320687 Oct 27 01:26:28.486303 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 208/412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:28 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:28.488046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:28.500868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c5944f16-ef56-453c-8a62-c73efa52fc9d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1510 microversion: 2.1 time: 0.348424 Oct 27 01:26:28.501576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 205/413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:28 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:29.510137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:29.510750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:29.513298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:29.518714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:29.519274 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:29.519780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:29.520543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:29.521082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:29.521512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:29.532808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:29.533946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:29.541910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:29.542277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:29.542772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:29.543535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:29.544349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:29.544683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:29.731417 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:29.740669 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-69a39414-ebc7-44eb-9171-0c396fb25342 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1504 microversion: 2.1 time: 0.234299 Oct 27 01:26:29.741921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 209/414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:29 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:29.767096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:29.775728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0a005953-65d1-49e3-acfe-1a33753afe7b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1516 microversion: 2.1 time: 0.247936 Oct 27 01:26:29.776361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 206/415] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:29 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:30.697358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf861c46-754d-4cac-84ce-bc96e2d30d29", "name": "network-vif-deleted", "tag": "eb8780e9-ea35-4a35-b3fe-dd15ac3322d4"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:30.708434 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:30.708905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:30.709352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:30.720295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] Creating event network-vif-deleted:eb8780e9-ea35-4a35-b3fe-dd15ac3322d4 for instance cf861c46-754d-4cac-84ce-bc96e2d30d29 on hv-cinder-81558 Oct 27 01:26:30.725839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-f2c1a5fa-936b-4311-ae3a-0f6e5cbd9f83 req-6ffb1118-8b07-468e-9ea6-15db4568f126 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Oct 27 01:26:30.726428 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 210/416] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:26:30.763959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:30.764565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:30.771376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:30.771858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:30.772292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:30.772981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:30.773465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:30.773901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:30.839750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:30.847399 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3094192a-e79c-4ff2-be76-ac9011b55fb8 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1462 microversion: 2.1 time: 0.087510 Oct 27 01:26:30.847963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 207/417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:30 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:31.871790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:31.872513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:31.880822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:31.881455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:31.882227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:31.883445 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:31.884010 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:31.884616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:31.918586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:31.919069 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:31.919500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:31.919962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lazy-loading 'fault' on Instance uuid cf861c46-754d-4cac-84ce-bc96e2d30d29 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:26:31.965829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:31.974337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-65a3eb1f-c82d-46ed-87ff-7f6c2051ac35 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 200 len: 1304 microversion: 2.1 time: 0.107345 Oct 27 01:26:31.974912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 211/418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:31 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:32.308264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-492ce26e-8bf2-4e86-ba16-6dc82a5d40d5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: .version_select at 0x7f6c130d4940>, body: {"keypair": {"name": "tempest-keypair-50530738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxE6geGhLa2qKc48NUOa3+EUz2w7T6AlqG1q79gDmzySgDKQEhtQoGYGBpRbd3U4QxpSq/Mk+NYA7deF/n4okibfDQRzEacvaKxd4BJRKnzGYfp9CvY+/ZYXSYD57ZguQ=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:32.334522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-492ce26e-8bf2-4e86-ba16-6dc82a5d40d5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for project 7eefe01b108148bab60d4de13be0405d. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:26:32.339546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-492ce26e-8bf2-4e86-ba16-6dc82a5d40d5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for user d311fc1f82124819b509f766fa432e2c and project 7eefe01b108148bab60d4de13be0405d. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:26:32.371827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-492ce26e-8bf2-4e86-ba16-6dc82a5d40d5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.068865 Oct 27 01:26:32.372610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 208/419] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:26:32 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:33.000320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:33.000879 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: cf861c46-754d-4cac-84ce-bc96e2d30d29] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:33.008524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:33.008994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:33.009457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:33.010141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:33.010581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:33.010994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:33.027662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] HTTP exception thrown: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Request method failure captured: Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 HTTP/1.1 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd4cOxQLdadLgfGO7rhsdK0dx--Iz8SAEqPB42hnYqtxuUDrIeSS7-ys_NyGj4pVKnJqo3Bhtpa9J3_eDO7UWtjkHHCLcZo5MlIeQU8YjJfUHLnp0EiGzk9EmZDexb_cTBznFpEciUudk6u6I7JhmQ1r_vWwjnCnxF09N2SpwFEp4z0 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a816bcfd87b34071a24b948c351811c4 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesActionsTest-537855645 Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:26:33.029564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a816bcfd87b34071a24b948c351811c4", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesActionsTest-537855645 Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a816bcfd87b34071a24b948c351811c4 Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesActionsTest-537855645 Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesActionsTest-537855645-project Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1505f37c15c0461a912d59172ebdf94a Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesActionsTest-537855645-project Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. Oct 27 01:26:33.030916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'cf861c46-754d-4cac-84ce-bc96e2d30d29'} Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:26:33.031661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. Oct 27 01:26:33.032785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:26:33.034222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Returning 404 to user: Instance cf861c46-754d-4cac-84ce-bc96e2d30d29 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:26:33.034222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7c2c291e-8c3f-435d-8ed5-fe2977d38f01 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29" status: 404 len: 111 microversion: 2.1 time: 0.034934 Oct 27 01:26:33.036223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 212/420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:32 2022] GET /compute/v2.1/servers/cf861c46-754d-4cac-84ce-bc96e2d30d29 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:26:33.143984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-344294774", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "networks": [{"uuid": "24be29c8-49a2-4c9f-8d22-b7f159d95f6b"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:33.199806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] validate_networks() for [('24be29c8-49a2-4c9f-8d22-b7f159d95f6b', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:26:33.860100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:26:33.862149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:26:33.863660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:26:33.864914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:26:33.865799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:26:33.878749 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:33.879678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:33.880197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:33.881726 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:33.882263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:33.882917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:33.906759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Getting quotas for project a816bcfd87b34071a24b948c351811c4. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:26:33.913611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Getting quotas for user 1505f37c15c0461a912d59172ebdf94a and project a816bcfd87b34071a24b948c351811c4. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:26:33.929347 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:26:33.931924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:26:33.991415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1b546b35-cec7-4553-84e9-2e5101be336a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851628 Oct 27 01:26:33.992775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 209/421] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:26:34.010521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-92b9ef52-c3e1-4408-9aaf-bb81f78f7db1 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:34.014230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-92b9ef52-c3e1-4408-9aaf-bb81f78f7db1 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:34.045457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-158862496", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03467824-1af5-46b4-9775-45b8ed4ca0b6"}], "security_groups": [{"name": "tempest-securitygroup--1578855061"}], "key_name": "tempest-keypair-50530738", "user_data": "}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:34.088016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-92b9ef52-c3e1-4408-9aaf-bb81f78f7db1 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:34.095990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-92b9ef52-c3e1-4408-9aaf-bb81f78f7db1 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1213 microversion: 2.1 time: 0.094894 Oct 27 01:26:34.096652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 213/422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:33 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:34.154717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] validate_networks() for [('03467824-1af5-46b4-9775-45b8ed4ca0b6', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:26:34.808547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:26:34.809151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:26:34.815660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:26:34.816119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:26:34.816554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:26:34.827727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:34.828802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:34.829672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:34.831039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:34.831797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:34.832290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:34.853046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:26:34.858627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Getting quotas for user d311fc1f82124819b509f766fa432e2c and project 7eefe01b108148bab60d4de13be0405d. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:26:34.872072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:26:34.874279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:26:34.927151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3975ea3d-a3fe-4506-95c4-9fcf509e01c6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.886424 Oct 27 01:26:34.927798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 210/423] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:26:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:26:34.939376 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7f2ec3c1-927c-4e67-86b9-5e16d8bbe55e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:34.940763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7f2ec3c1-927c-4e67-86b9-5e16d8bbe55e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:35.021974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f2ec3c1-927c-4e67-86b9-5e16d8bbe55e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:35.035608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7f2ec3c1-927c-4e67-86b9-5e16d8bbe55e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1243 microversion: 2.1 time: 0.099937 Oct 27 01:26:35.036469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 214/424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:34 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1243 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:35.119988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:35.120831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:35.128384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:35.128954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:35.129410 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:35.130094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:35.130538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:35.131020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:35.203546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:35.220474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e1ecf129-00d9-46b5-97fd-df932883cc70 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1265 microversion: 2.1 time: 0.104466 Oct 27 01:26:35.221126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 211/425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:35 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:36.061467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:36.062066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:36.069683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:36.070385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:36.070820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:36.071513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:36.071963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:36.072383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:36.155750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:36.167526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f3eb8ac0-f011-4e4e-a8e8-21935cb0c909 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1295 microversion: 2.1 time: 0.110438 Oct 27 01:26:36.169159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 215/426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:36 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:36.243878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:36.244493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:36.250778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:36.251267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:36.251696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:36.252387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:36.252850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:36.253304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:36.426322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:36.436217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fed61fa1-6986-4ba1-a47c-1bce9b0dcd1d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.196100 Oct 27 01:26:36.448147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 212/427] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:36 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:37.194154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:37.194773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:37.201586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:37.202063 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:37.202508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:37.203234 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:37.203686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:37.204102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:37.266610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:37.276339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f9341377-db9a-4fff-9ca9-5bfbda140804 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1301 microversion: 2.1 time: 0.085926 Oct 27 01:26:37.276912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 216/428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:37 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:37.462434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:37.463625 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:37.469874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:37.470350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:37.470954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:37.471741 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:37.472191 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:37.472609 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:37.611068 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:37.619337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-72c58c94-65b3-44b9-a8c0-37f8427371aa tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.160764 Oct 27 01:26:37.619908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:37 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:37.707280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75642481-f019-4830-936c-c827e8be6ce9", "tag": "bf2aef4f-d112-40b8-bffe-35991a3e001d"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:37.717699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:37.718175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:37.718605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:37.729736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] Creating event network-changed:bf2aef4f-d112-40b8-bffe-35991a3e001d for instance 75642481-f019-4830-936c-c827e8be6ce9 on hv-cinder-81558 Oct 27 01:26:37.735131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-28bc72e5-6ed4-4d4e-a5c7-88270d009ac5 req-075eb411-3e28-4b9d-862c-cb2b79d629ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030995 Oct 27 01:26:37.736792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 217/430] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:38.300431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:38.301534 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:38.307759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:38.308236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:38.308669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:38.309394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:38.310432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:38.310856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:38.434537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:38.443158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b2f7af8f-4804-4b34-bb96-a7ea4f00e7f6 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.146947 Oct 27 01:26:38.443709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 214/431] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:38 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:38.643831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:38.644554 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:38.650583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:38.651055 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:38.651500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:38.652155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:38.652600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:38.653015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:38.781870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:38.790002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2dcba359-d88f-4f4c-b8ae-e9fd8a0aa2c0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.151015 Oct 27 01:26:38.790559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 218/432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:38 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:39.467704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:39.468303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:39.474599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:39.475095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:39.475566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:39.476265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:39.476722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:39.477179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:39.604625 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:39.613176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d76cbb8c-3b5c-4682-9ff4-92a0b51b8ac3 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.149302 Oct 27 01:26:39.613941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 215/433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:39 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:39.813016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:39.813656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:39.820203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:39.820692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:39.821149 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:39.821840 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:39.822289 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:39.822708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:39.952048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:39.960118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9ceea53f-adbb-441e-ab4d-9d81700f11d0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.150965 Oct 27 01:26:39.960681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 219/434] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:39 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:40.636338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:40.637011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:40.643505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:40.644034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:40.644474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:40.645197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:40.645656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:40.646086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:40.776639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:40.784896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0f3eb686-9a56-4390-8b82-5e36909ad566 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.152467 Oct 27 01:26:40.785486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 216/435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:40 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:40.983516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:40.984117 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:40.990825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:40.991314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:40.991722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:40.992396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:40.992838 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:40.993278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:41.122455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:41.130625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-59c638a8-4d5a-4977-b524-e44d6a6e8f04 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.150912 Oct 27 01:26:41.139044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 220/436] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:40 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:41.807667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:41.808274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:41.814805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:41.815302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:41.815739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:41.816432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:41.816886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:41.817338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:41.948584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:41.956842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-90ee6c7a-8cac-40cc-9e2a-ed121cae15a7 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.153225 Oct 27 01:26:41.957444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 217/437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:41 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:42.153500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:42.155041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:42.161386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:42.161940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:42.162437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:42.163208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:42.163724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:42.164248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:42.292522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:42.300877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6ce3ed88-abd0-4f93-a2e2-5c2a10c6e68f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.151154 Oct 27 01:26:42.301622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 221/438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:42 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:42.979818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:42.980521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:42.986397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:42.986871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:42.987300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:42.987982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:42.988424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:42.988841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:43.123291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:43.132335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e58fe5b7-75a1-4d73-b142-f5280a5b4f05 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.156301 Oct 27 01:26:43.133189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 218/439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:42 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:43.261455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:43.276145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:43.276863 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:43.277347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:43.288863 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] Creating event network-changed:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:26:43.293743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-d161fcca-bc5c-4102-b13e-aad695cdcdf9 req-8073ef2b-ed6a-4573-a0b2-0a967246745a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043457 Oct 27 01:26:43.294338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 222/440] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:43.323709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:43.324314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:43.330809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:43.331288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:43.331723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:43.332411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:43.332864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:43.333311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:43.465148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:43.472816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c360b2f9-f126-4031-a5b2-8e0d84702e2a tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.152939 Oct 27 01:26:43.473489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 219/441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:43 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:44.155951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:44.156775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:44.163818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:44.164367 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:44.164871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:44.165673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:44.166125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:44.166545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:44.306004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:44.313852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a131d37b-84ca-4349-8bce-afd0a8b0cf2a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.162195 Oct 27 01:26:44.329316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 223/442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:44 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:44.495212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:44.495767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:44.502351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:44.502875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:44.503310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:44.504000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:44.504468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:44.504880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:44.636434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:44.643999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-af16627c-c939-4f03-9317-ec9f6b233508 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.152814 Oct 27 01:26:44.644773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 220/443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:44 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:45.342199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:45.342654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:45.344892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:45.351576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:45.352058 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:45.352496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:45.353315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:45.353770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:45.354196 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:45.356757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:45.490113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:45.498446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1108dbca-ead4-4b54-b9e3-bb85018eac57 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.160137 Oct 27 01:26:45.499087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 224/444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:45 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:45.667129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:45.667876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:45.669879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=4 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:45.670543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=16 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:45.676833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:45.677603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:45.678079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:45.678783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:45.679243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:45.679921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:45.822822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:45.831468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0d44908a-9314-40d3-8b8c-350eb93b5d7e tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.168569 Oct 27 01:26:45.832023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 221/445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:45 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:46.521778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:46.522386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:46.528803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:46.529320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:46.529760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:46.530447 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:46.530902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:46.531328 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:46.660802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:46.668702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-458ac657-844e-4901-9914-44e568f6dc34 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.150815 Oct 27 01:26:46.669453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 225/446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:46 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:46.912548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:46.913149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:46.919079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:46.919559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:46.920007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:46.920679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:46.921156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:46.921589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:46.925482 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:47.057184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:47.065792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-aa1e7064-1501-4a62-978a-37b51c89642d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.157590 Oct 27 01:26:47.066246 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 222/447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:46 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:47.692364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:47.693328 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:47.701327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:47.702189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:47.702634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:47.703655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:47.704403 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:47.705814 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:47.864005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:47.872106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a162c3be-6999-4c2a-b4c5-913c0e32526d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.184304 Oct 27 01:26:47.872681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 226/448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:47 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:48.091982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:48.093247 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:48.100334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:48.100825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:48.101541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:48.102430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:48.103034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:48.103554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:48.257906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:48.265797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-75fb54f2-e132-48cc-9a72-160142020aca tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.178081 Oct 27 01:26:48.266363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 223/449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:48 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:48.898061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:48.898767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:48.905779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:48.906349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:48.906937 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:48.907692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:48.909051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:48.909502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:49.080625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:49.090444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a75f55ed-10eb-40e5-901d-dcfc28161b7d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.196255 Oct 27 01:26:49.091039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 227/450] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:48 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:49.289727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:49.290340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:49.296323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:49.296840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:49.297310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:49.298024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:49.298661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:49.299230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:49.465093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:49.478111 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d4bd20fc-b2c8-4c25-a171-25b521a66e6f tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.192088 Oct 27 01:26:49.478712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 224/451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:49 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:49.526513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75642481-f019-4830-936c-c827e8be6ce9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2aef4f-d112-40b8-bffe-35991a3e001d"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:49.543478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:49.544167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:49.544775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:49.557707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] Creating event network-vif-plugged:bf2aef4f-d112-40b8-bffe-35991a3e001d for instance 75642481-f019-4830-936c-c827e8be6ce9 on hv-cinder-81558 Oct 27 01:26:49.566597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-85d3937c-1ab5-4190-a1f8-c4d16fa3daea req-b4e11037-b1c0-46ee-8531-d01eadfa0fa1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050934 Oct 27 01:26:49.567144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 228/452] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:50.115551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:50.116276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:50.122654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:50.123213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:50.123718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:50.124481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:50.125027 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:50.125632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:50.263958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:50.272283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-be5e22b3-d64b-4db2-9886-034034da5d12 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.161732 Oct 27 01:26:50.272847 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 225/453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:50 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:50.502903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:50.503593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:50.509692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:50.510174 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:50.510601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:50.511288 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:50.511737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:50.512160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:50.668298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:50.678856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-808458fa-87b8-47cb-8006-52dbf846f49b tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.180982 Oct 27 01:26:50.679853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 229/454] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:50 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:51.295262 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:51.296591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:51.305034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:51.305558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:51.305999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:51.306711 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:51.307172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:51.307602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:51.443576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:51.452491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eb6b5a41-c515-44bb-9759-4076fcb86e8e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.161015 Oct 27 01:26:51.453281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 226/455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:51 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:51.703483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:51.704094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:51.711111 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:51.711739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:51.712025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:51.712716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:51.713229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:51.713644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:51.896546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:51.905546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-59b8b95d-e049-4f77-b8bb-3be33c4be726 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.205980 Oct 27 01:26:51.906143 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 230/456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:51 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:52.479325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:52.480582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:52.502635 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:52.503552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:52.503991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:52.504963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:52.505857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:52.506865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:52.662788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:52.671657 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ed3584b7-214d-428b-a1ba-03c8d8199a5f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.196290 Oct 27 01:26:52.676447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 227/457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:52 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:52.930606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:52.931211 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:52.937499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:52.937978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:52.938412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:52.939100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:52.939544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:52.939975 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:53.075121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:53.083442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-90aa3566-b49d-4ab9-afbd-94bb19ae2bf0 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.156940 Oct 27 01:26:53.084200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 231/458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:52 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:53.700556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:53.701811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:53.710335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:53.711648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:53.712261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:53.713285 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:53.713747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:53.714176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:53.830141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-778969020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-747643760", "security_groups": [{"name": "tempest-secgroup-smoke-1700913311"}], "networks": [{"uuid": "b67084fb-2a24-49ee-9833-86835b5c48d2"}], "block_device_mapping_v2": [{"uuid": "d56a9672-b319-4ee2-998a-2bf7793ed105", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:53.887410 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:53.896202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5988b2b2-7135-4120-aad2-c052b3835d0f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.201946 Oct 27 01:26:53.896972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 228/459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:53 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:53.974499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] validate_networks() for [('b67084fb-2a24-49ee-9833-86835b5c48d2', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:26:54.107223 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:54.107834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:54.115446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.116033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.116658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:54.117391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.118006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.118454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:54.339801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:54.349274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d0c6e0d0-c5e2-4d7b-8732-1e62d0cf3652 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1313 microversion: 2.1 time: 0.245861 Oct 27 01:26:54.351444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 229/460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:54 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:54.480482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:26:54.481279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:26:54.481972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:26:54.482568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:26:54.483191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:26:54.493306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.494135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.494793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:54.495792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.496530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.497045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:54.518951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Getting quotas for project 40ecdf4e71844f7f9e3da7f59659b605. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:26:54.524298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Getting quotas for user 181df03f4bba4f96afc3c888b3ca9b4d and project 40ecdf4e71844f7f9e3da7f59659b605. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:26:54.597352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:26:54.599643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d56a9672-b319-4ee2-998a-2bf7793ed105',volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:26:54.744080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-01a3989d-0090-4c2c-8886-d331832d9414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.917759 Oct 27 01:26:54.745218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 232/461] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:26:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:26:54.757121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-454184b0-efa9-4724-a748-db9217161414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:54.758451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-454184b0-efa9-4724-a748-db9217161414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:54.760420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:54.844404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-454184b0-efa9-4724-a748-db9217161414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:54.851899 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-454184b0-efa9-4724-a748-db9217161414 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1087 microversion: 2.1 time: 0.099025 Oct 27 01:26:54.857545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 230/462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:54 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1087 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:54.919753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:54.920369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:54.927736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.928227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.928673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:54.929662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:54.930325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:54.930720 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:55.100570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:55.109118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-644bd7c8-40e6-4e30-875a-4d915611eb8a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.193127 Oct 27 01:26:55.109977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 233/463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:54 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:55.374906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:55.375960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:55.385113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:55.385300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:55.385717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:55.386384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:55.386832 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:55.387348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:55.549311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:55.559859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5880fede-f1a5-4a56-aeb4-29df2648e63d tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1497 microversion: 2.1 time: 0.188831 Oct 27 01:26:55.560520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 231/464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:55 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:55.876259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:55.877483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:55.885604 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:55.886092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:55.886535 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:55.887429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:55.887858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:55.888299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:55.980916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:55.990723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7e71e476-2a43-4003-a79e-ba0afcdb64b8 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1185 microversion: 2.1 time: 0.119474 Oct 27 01:26:55.991603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 234/465] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:55 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:56.021746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "name": "network-vif-plugged", "status": "completed", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:26:56.039400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.040419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.040868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.059119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] Creating event network-vif-plugged:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:26:56.068816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-bf0807f4-b9ef-44fb-990e-504ef4757371 req-cd61d0c0-b739-488f-bc84-aa6b13c165b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052664 Oct 27 01:26:56.069554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 232/466] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:26:56.133619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:56.134221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:56.141250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.141740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.142176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.142871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.143564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.144148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.315438 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:56.316818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:56.323913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.324671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.325344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.326628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.327310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.327967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.366334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:26:56.414709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:56.428732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-be4785d8-83e9-4292-aace-e25026e7ee09 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.299345 Oct 27 01:26:56.429618 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 235/467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:56 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:56.531065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1ad8d828-04aa-4176-aff5-196c157d67bb tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 204 len: 0 microversion: 2.1 time: 0.219515 Oct 27 01:26:56.532410 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 233/468] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:26:56 2022] DELETE /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 01:26:56.541500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:56.542443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:56.551020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.551549 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.551992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.552748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:56.553229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:56.553819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:56.711192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:56.720854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3471036b-7293-401f-9bd3-a186031f9ed2 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1503 microversion: 2.1 time: 0.183375 Oct 27 01:26:56.721526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 236/469] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:56 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:26:57.017936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:57.019359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:57.025118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.025774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.026026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.026717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.027261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.027685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.094770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:57.103434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-15b13932-abef-481a-a2fe-28010ad0b976 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1203 microversion: 2.1 time: 0.089637 Oct 27 01:26:57.103925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 234/470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:57 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1203 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:57.453404 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:57.454079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:57.460660 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.461178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.461620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.462326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.462783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.463232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.591168 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:57.599233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a966fea0-8bb7-4586-a26e-31906cb2d8e8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.150863 Oct 27 01:26:57.599797 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 237/471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:57 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:57.745281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:57.745896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:57.751835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.752323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.752762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.753669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:57.754011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:57.754469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:57.927685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:57.935871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5ff10bd1-56eb-4a5c-8dd0-4f64bb448c68 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1503 microversion: 2.1 time: 0.194487 Oct 27 01:26:57.936437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 235/472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:57 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:58.127721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:58.128414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:58.134501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.134981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.135416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:58.136100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.136550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.136974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:58.198565 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:58.206977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-50ffb0ab-4414-49f3-a9b7-7be6b2d9d173 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1203 microversion: 2.1 time: 0.083048 Oct 27 01:26:58.207536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 238/473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:58 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1203 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:58.621802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:58.622516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:58.629680 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.630162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.630630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:58.631313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.631760 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.632210 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:58.783531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:58.797647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e2708fcc-0c10-4c79-a35a-b0afee7693f4 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.179094 Oct 27 01:26:58.809687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 236/474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:58 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:58.962941 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:58.963522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:58.969448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.969982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.970514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:58.971397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:58.972698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:58.973265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:59.104799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:59.112639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-68b52127-43ea-4009-a4c2-52d057e4edcf tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1503 microversion: 2.1 time: 0.156323 Oct 27 01:26:59.113260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 239/475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:58 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:59.230905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:59.231422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:59.237526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:59.237938 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:59.238368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:59.239642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:59.240106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:59.240540 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:59.303304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:59.311242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f9a9ec2e-ef4b-45f0-8d70-73d1b1363167 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1203 microversion: 2.1 time: 0.084368 Oct 27 01:26:59.311796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 237/476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:59 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:26:59.822580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:26:59.823186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:26:59.825216 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:26:59.830540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:59.831738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:59.832342 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:59.833123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:26:59.833581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:26:59.834005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:26:59.981132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:26:59.990188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-731bf436-6cfe-48f6-a3a9-3a6e2597967b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1369 microversion: 2.1 time: 0.171548 Oct 27 01:26:59.992751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 240/477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:26:59 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:00.136786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:00.137404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:00.144452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:00.145231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:00.145870 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:00.146738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:00.147233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:00.147746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:00.335518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:00.336292 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:00.352087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:00.352738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:00.353327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:00.354131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:00.354652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:00.356977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:00.358917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:00.363290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:00.368705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0283c8b7-6da5-4f57-be4d-6606f3bf1f83 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1503 microversion: 2.1 time: 0.235856 Oct 27 01:27:00.369308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 238/478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:00 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:00.430871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75642481-f019-4830-936c-c827e8be6ce9", "name": "network-vif-deleted", "tag": "bf2aef4f-d112-40b8-bffe-35991a3e001d"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:00.445544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:00.446444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:00.446924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:00.455346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:00.465448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] Creating event network-vif-deleted:bf2aef4f-d112-40b8-bffe-35991a3e001d for instance 75642481-f019-4830-936c-c827e8be6ce9 on hv-cinder-81558 Oct 27 01:27:00.466376 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a9d45df-9ed2-459f-8b60-ee744500c1cc tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1203 microversion: 2.1 time: 0.134706 Oct 27 01:27:00.471992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-d9d8cd59-dbe9-4fd7-80a0-ffb537e66d9e req-ea001032-585f-408b-8caf-ea2289f45985 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045097 Oct 27 01:27:00.472871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 239/479] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:00.477676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 241/480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:00 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1203 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:01.030128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:01.030829 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:01.037695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.038183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.038627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.039329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.039785 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.040213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.190827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:01.198922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-098b82e0-60f0-4d23-9411-1492cdca2feb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1564 microversion: 2.1 time: 0.173170 Oct 27 01:27:01.199622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 240/481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:01 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:01.227900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:01.228398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:01.235810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.236305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.236751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.237844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.238563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.239249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.261175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:01.337936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-95ed7555-d66e-41a4-bffa-62767e7f5077 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114398 Oct 27 01:27:01.339238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 242/482] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:27:01 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:01.412979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:01.417494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:01.427501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.434430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.435164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.436041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.436580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.437005 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.490278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:01.491120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:01.499950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.501505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.502437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.506502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.507101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.508538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.515387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:01.516118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:01.516734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:01.517546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lazy-loading 'fault' on Instance uuid 75642481-f019-4830-936c-c827e8be6ce9 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:27:01.576685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1505f37c15c0461a912d59172ebdf94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a816bcfd87b34071a24b948c351811c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:01.585896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c07bccf4-c70a-4042-ad7f-8074415f3462 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 200 len: 1303 microversion: 2.1 time: 0.184374 Oct 27 01:27:01.589487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 241/483] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:01 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:01.825418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:01.834342 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ea4e066a-89e9-4539-a3e2-4dded9178565 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.348466 Oct 27 01:27:01.835581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 243/484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:01 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:02.499248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:02.508818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.509545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.509982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:02.521454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] Creating event network-changed:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:27:02.526975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-64babce5-c4b1-4aba-a0b8-f46c1dfdee0e req-69dd0c0b-4294-4b7a-914e-2e67eeaea4d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031328 Oct 27 01:27:02.527865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 242/485] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:02.625151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:02.625151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] [instance: 75642481-f019-4830-936c-c827e8be6ce9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:02.625151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.625151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.625784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:02.625784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.625784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.625784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:02.640144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] HTTP exception thrown: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Request method failure captured: Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 HTTP/1.1 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd4cOxQLdadLgfGO7rhsdK0dx--Iz8SAEqPB42hnYqtxuUDrIeSS7-ys_NyGj4pVKnJqo3Bhtpa9J3_eDO7UWtjkHHCLcZo5MlIeQU8YjJfUHLnp0EiGzk9EmZDexb_cTBznFpEciUudk6u6I7JhmQ1r_vWwjnCnxF09N2SpwFEp4z0 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: a816bcfd87b34071a24b948c351811c4 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesActionsTest-537855645 Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:27:02.642049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a816bcfd87b34071a24b948c351811c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a816bcfd87b34071a24b948c351811c4", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesActionsTest-537855645 Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: a816bcfd87b34071a24b948c351811c4 Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesActionsTest-537855645 Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesActionsTest-537855645-project Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 1505f37c15c0461a912d59172ebdf94a Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesActionsTest-537855645-project Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. Oct 27 01:27:02.643894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '75642481-f019-4830-936c-c827e8be6ce9'} Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:27:02.644606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. Oct 27 01:27:02.645950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:27:02.647258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] Returning 404 to user: Instance 75642481-f019-4830-936c-c827e8be6ce9 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:27:02.647258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-63b09fc2-80a2-4e3f-a4b0-bc551bc5e6e5 tempest-VolumesActionsTest-537855645 tempest-VolumesActionsTest-537855645-project] 10.222.0.42 "GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9" status: 404 len: 111 microversion: 2.1 time: 0.035367 Oct 27 01:27:02.647258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 244/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:02 2022] GET /compute/v2.1/servers/75642481-f019-4830-936c-c827e8be6ce9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:27:02.743173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:02.754728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.755481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.756127 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:02.771719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] Creating event network-changed:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:27:02.777512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-6a5db65e-5462-42f4-a72c-c7baf46274e7 req-a1ab64ff-22d6-4ed8-b195-28a30183089d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040081 Oct 27 01:27:02.779004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 243/487] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:27:02.858897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:02.860100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:02.868954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.870376 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.871200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:02.872232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:02.872946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:02.873665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:03.055735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:03.063934 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4b04b298-d1fc-42cf-8e68-beed752c67af tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.209842 Oct 27 01:27:03.064524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 245/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:02 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:04.088224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:04.089590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:04.095711 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:04.096201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:04.096869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:04.097676 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:04.098134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:04.098562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:04.245411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:04.253258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-56110726-e46e-415f-8d53-02ab758c0610 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.169245 Oct 27 01:27:04.253822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 244/489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:04 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:05.276106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:05.277002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:05.279746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:05.280406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:05.287609 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:05.288089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:05.288519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:05.289237 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:05.289687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:05.290101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:05.425769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:05.433783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d3d2b690-1823-4002-8c67-6f42e00bf6d6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.162008 Oct 27 01:27:05.434639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 246/490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:05 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:06.457403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:06.458009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:06.460010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:06.465371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:06.465852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:06.466286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:06.466968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:06.467418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:06.467841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:06.598439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:06.605973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3c5c2d74-7e19-490e-a453-408bbec0628e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.152642 Oct 27 01:27:06.606464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 245/491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:06 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:07.628011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:07.628616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:07.635424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:07.635912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:07.636348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:07.637038 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:07.637516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:07.637942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:07.773628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:07.781245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-46ca1996-cda2-4b9c-b900-7a261ebddb88 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.157076 Oct 27 01:27:07.781807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 247/492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:07 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:08.804512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:08.805148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:08.811168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:08.811649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:08.812080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:08.812771 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:08.813255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:08.813682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:08.944462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:08.952140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-49c068cc-f2b8-438a-8fc2-08c75c771c07 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.151833 Oct 27 01:27:08.952700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 246/493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:08 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:09.975081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:09.975956 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:09.982464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:09.982951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:09.983383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:09.984067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:09.984517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:09.984942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:10.116913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:10.124508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9949dace-edc5-41cb-990b-ef66ea581f82 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.153335 Oct 27 01:27:10.125080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 248/494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:09 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:11.148039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:11.148569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:11.154569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:11.155884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:11.156328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:11.157020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:11.157495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:11.157921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:11.297086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:11.305561 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-15ae1d66-eb41-41b5-971c-9c3688e0363d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.161685 Oct 27 01:27:11.306118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 247/495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:11 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:12.327743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:12.328358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:12.336126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:12.336620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:12.337072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:12.337773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:12.338227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:12.338652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:12.467176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:12.474677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fc9b5451-2d54-4bc3-96d5-5e5f0b1878d1 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.150892 Oct 27 01:27:12.475235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 249/496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:12 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:13.497895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:13.498485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:13.504712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:13.505219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:13.505650 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:13.506667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:13.507121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:13.507539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:13.641937 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:13.650257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7d59f5c6-233b-4437-9474-33bba2f74881 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.157114 Oct 27 01:27:13.650819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 248/497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:13 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:14.673553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:14.674159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:14.681501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:14.681990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:14.682429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:14.683124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:14.683579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:14.684002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:14.845486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:14.853643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-67c3f696-1529-4b8e-ba6c-7c6809a351ae tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.184028 Oct 27 01:27:14.854219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 250/498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:14 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:15.877828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:15.879416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:15.885972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:15.886579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:15.887230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:15.888000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:15.888537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:15.889148 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:16.039062 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:16.047164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-68393e09-bd15-4f29-879c-cfecdb882317 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.173415 Oct 27 01:27:16.048215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 249/499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:15 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:16.473856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "name": "network-vif-plugged", "status": "completed", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:16.484415 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:16.484958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:16.485475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:16.498583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] Creating event network-vif-plugged:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:27:16.504548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-85eee19f-c11f-4904-9773-3e07609cc2e4 req-52a26938-aaca-4083-9089-7e6f66b63ee6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034481 Oct 27 01:27:16.505467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 251/500] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:17.071092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:17.072350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:17.078541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:17.079237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:17.079677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:17.080377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:17.080831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:17.081296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:17.214661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:17.224361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-01644523-d30f-4486-9670-a176a38ee6b9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.156938 Oct 27 01:27:17.225431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 250/501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:17 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:18.250656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:18.252059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:18.274681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:18.280284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:18.280920 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:18.281820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:18.282759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:18.287535 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:18.501281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:18.501281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8133f0fe-88e1-4988-bbbc-be8a54f3b413 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1259 microversion: 2.1 time: 0.257341 Oct 27 01:27:18.518782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 252/502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:18 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1259 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:19.525991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:19.527545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:19.537899 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:19.538411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:19.539164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:19.540190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:19.540861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:19.541504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:19.729397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:19.739001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4f28e350-152d-4aff-a3fe-53fadaba2694 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1442 microversion: 2.1 time: 0.217743 Oct 27 01:27:19.755992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 251/503] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:19 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1442 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:19.766820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:19.768500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:19.776818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:19.777352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:19.778043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:19.779232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:19.779946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:19.780593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:19.975231 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:19.987067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a23c73a8-777e-4e49-a741-ffa056947504 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1442 microversion: 2.1 time: 0.224845 Oct 27 01:27:20.000094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 253/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:19 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1442 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:22.952505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:22.963257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:22.963745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:22.964180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:22.977308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] Creating event network-changed:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:27:22.982727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-e46ec09d-9425-42b1-8760-050c97631094 req-3f3a6645-1ee4-48f8-9589-29ce0c4f8535 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 Oct 27 01:27:22.986846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 252/505] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:39.744238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:39.744857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:39.747821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=27 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:39.748496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=61 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:39.754593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:39.755080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:39.755545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:39.756308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:39.756802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:39.757360 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:39.784024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-09dbd734-cb23-4465-b128-b24906439e4d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/ips" status: 200 len: 149 microversion: 2.1 time: 0.043776 Oct 27 01:27:39.785284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 254/506] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:27:39 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:40.677725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:40.678467 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=70 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:40.682850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:40.683418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:40.691695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:40.692609 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:40.693049 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:40.693801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:40.694260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:40.694683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:40.718584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-76bc5617-e81b-4f20-8ff6-bf391e78c5aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/ips" status: 200 len: 145 microversion: 2.1 time: 0.043014 Oct 27 01:27:40.719168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 253/507] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:27:40 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:41.174567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64dc1d60-eefd-4a11-9719-3e6145580771"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:41.177708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:41.185314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:41.185314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:41.186091 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:41.188699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:41.189232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:41.189663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:41.471199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6e54a926-99f8-4d62-a5e7-f8c27810cf41 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300119 Oct 27 01:27:41.474774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 255/508] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:27:41 2022] POST /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:44.243700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2127df-26ed-4aaa-94ba-e88fbb27dbdb"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:44.246063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:44.252034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:44.252516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:44.252952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:44.253673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:44.254177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:44.254672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:44.553118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-140defd4-a3cf-4801-b777-6da875a202b9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314548 Oct 27 01:27:44.557652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 254/509] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:27:44 2022] POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:50.075155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-655978a7-bd6d-4463-a757-ad60cfb27dd8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: .version_select at 0x7f6c13078040>, body: {"keypair": {"name": "tempest-keypair-1253702812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuBVhc18z1V9pa2zjtX1V5o11D4pyKSQ0B2ISnTx3CR9o2q1OVzxTp7xBEG2lfDs6YZfMS5Y4cnfMST54J1zUYfyuEm9IDmWCQNuaSDLazsnaeg/Q7lSLCJazxgoiqb0Q=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:50.091093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-655978a7-bd6d-4463-a757-ad60cfb27dd8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:27:50.094865 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-655978a7-bd6d-4463-a757-ad60cfb27dd8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:27:50.117221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-655978a7-bd6d-4463-a757-ad60cfb27dd8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046198 Oct 27 01:27:50.117800 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 256/510] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:27:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:51.361930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1006802828", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ba9997c-2f90-403d-993a-09c134c8fd7e"}], "security_groups": [{"name": "tempest-securitygroup--1283787689"}], "key_name": "tempest-keypair-1253702812", "user_data": "}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:51.465989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] validate_networks() for [('4ba9997c-2f90-403d-993a-09c134c8fd7e', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:27:51.834069 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:27:51.834500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:27:51.834979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:27:51.835423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:27:51.835921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:27:51.845706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:51.846190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:51.846627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:51.847353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:51.847804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:51.848432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:51.865320 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:27:51.869374 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:27:51.880809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:27:51.883217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:27:51.931956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-97bb6d38-5fd0-4469-915d-a87d82700497 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574661 Oct 27 01:27:51.932652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 255/511] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:27:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 01:27:51.944855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e50a7f7f-e7b8-41d1-acb4-a6aa2fa83ed4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:51.945615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e50a7f7f-e7b8-41d1-acb4-a6aa2fa83ed4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:51.949392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:27:52.008400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e50a7f7f-e7b8-41d1-acb4-a6aa2fa83ed4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:52.016189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e50a7f7f-e7b8-41d1-acb4-a6aa2fa83ed4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1242 microversion: 2.1 time: 0.076353 Oct 27 01:27:52.017093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:51 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:53.040057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:53.040663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:53.047449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:53.047930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:53.048522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:53.049038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:53.049518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:53.049941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:53.122283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:53.130289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bbe4ec8a-b8ed-40f6-9917-e33c02c08d7e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1294 microversion: 2.1 time: 0.095160 Oct 27 01:27:53.130845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 256/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:53 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:54.161558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:54.161558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:54.161558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:54.162250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:54.162633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:54.163394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:54.163915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:54.164397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:54.228857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:54.236822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-530f444e-ce99-45f7-9ae4-21327b50993f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1300 microversion: 2.1 time: 0.087397 Oct 27 01:27:54.237420 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 258/514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:54 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:55.137890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f4c33b-ade5-4dbc-821f-a0d9273b643f", "tag": "ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:55.148682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:55.149275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:55.149742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:55.161283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] Creating event network-changed:ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9 for instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f on hv-cinder-81558 Oct 27 01:27:55.165982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-68dfe77c-6a2f-4bfd-b2a1-ca04132e7e87 req-859f296c-6528-45c0-af2d-20287180639e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Oct 27 01:27:55.166748 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 257/515] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:27:55.260346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:55.260896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:55.267418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:55.267902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:55.268340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:55.269034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:55.269516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:55.270586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:55.399102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:55.406699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-bcafd402-825e-41a3-a7d8-d5e263ffbbbe tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.150326 Oct 27 01:27:55.407254 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 259/516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:55 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:56.431719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:56.432608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:56.439199 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:56.439778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:56.440521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:56.441442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:56.442152 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:56.442663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:56.578384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:56.586957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ccbaf377-5def-4290-b8b4-6c2b4fa963f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.161311 Oct 27 01:27:56.587537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 258/517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:56 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:57.406846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:27:57.414471 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:57.414949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:57.415374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:57.477383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Going to try to stop instance {{(pid=118905) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 01:27:57.523363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1f1207e3-3d1f-4f90-b1f9-6252fefa7661 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action" status: 202 len: 0 microversion: 2.1 time: 0.120203 Oct 27 01:27:57.523961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 260/518] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:27:57 2022] POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:27:57.532112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:57.532750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:57.539780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:57.540261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:57.540699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:57.541425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:57.541877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:57.542303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:57.610385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:57.611076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:57.618430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:57.619323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:57.619323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:57.620086 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:57.620539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:57.620961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:57.695663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:57.703858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-97e11d7e-f757-44b5-8ee1-75f9b9c6855d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.175518 Oct 27 01:27:57.704422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 259/519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:57 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:57.763323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:57.771444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-acdcec30-7496-43fd-92af-59e03642505c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.165297 Oct 27 01:27:57.772142 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 261/520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:57 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:58.727587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:58.729112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:58.734653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:58.735124 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:58.735556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:58.736239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:58.736686 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:58.737133 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:58.795214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:58.795792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:58.803779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:58.804264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:58.804701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:58.805432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:58.805877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:58.806309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:58.911204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:58.919720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ccd5c3e0-8fcc-4b4c-8dee-afc76fe53b5c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.195943 Oct 27 01:27:58.920543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 260/521] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:58 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:27:58.959495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:27:58.967411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dbf8fb55-0856-4d67-9c68-e40dd6a5c1de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.176049 Oct 27 01:27:58.967969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 262/522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:58 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:27:59.944457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:59.945173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:59.951327 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:59.951807 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:59.952242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:59.952930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:59.953408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:59.953835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:59.990226 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:27:59.990842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:27:59.998291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:59.998500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:27:59.998779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:27:59.999472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:27:59.999917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:00.000335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:00.152960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:00.165139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f338336f-cd52-4e38-b8f0-4696aa5484c5 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.225495 Oct 27 01:28:00.166325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 261/523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:59 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:00.177165 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:00.185610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6c901b8b-c8fc-41da-aa6f-ee2782da9b34 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.199767 Oct 27 01:28:00.186189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 263/524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:27:59 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:01.190110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:01.190712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:01.198138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:01.198619 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:01.199050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:01.199735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:01.200183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:01.200602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:01.212125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:01.212736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:01.219435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:01.219918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:01.220598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:01.221579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:01.222243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:01.222921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:01.421103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:01.433284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-faa7c394-9433-4caf-abb2-05dc837c33c2 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.247468 Oct 27 01:28:01.445724 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 262/525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:01 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:01.476988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:01.484839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-42f4e8d2-2624-4de4-997b-9d41dc27b1c9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.276280 Oct 27 01:28:01.485324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 264/526] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:01 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:02.460977 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:02.461663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:02.464735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:02.465385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:02.470521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:02.471009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:02.471449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:02.472152 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:02.473279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:02.473733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:02.508038 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:02.508625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:02.511748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:02.515882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:02.516356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:02.516781 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:02.517500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:02.517943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:02.518359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:02.664446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:02.675218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3f11d72e-4185-47e0-bb50-adf7fbacd5c3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.219606 Oct 27 01:28:02.676388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 263/527] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:02 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:02.696284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:02.703929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7b28acd9-8cca-4d2c-aa45-f7ef6e33ff84 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.199998 Oct 27 01:28:02.704497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 265/528] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:02 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:02.749871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f4c33b-ade5-4dbc-821f-a0d9273b643f", "name": "network-vif-plugged", "status": "completed", "tag": "ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:02.759907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:02.760411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:02.761011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:02.775415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] Creating event network-vif-plugged:ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9 for instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f on hv-cinder-81558 Oct 27 01:28:02.780376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-34f9d29b-aa8f-40ce-b0af-e64def5265e2 req-e4eee296-cdd3-452d-bedb-19c7c685a0a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Oct 27 01:28:02.781089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 264/529] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:03.699900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:03.700511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:03.707551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:03.708129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:03.708562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:03.709278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:03.709727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:03.710148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:03.728556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:03.729316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:03.735458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:03.735939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:03.736669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:03.737426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:03.737878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:03.738598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:03.911402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:03.918626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:03.919572 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ead63d78-2d96-4f08-b24c-48aaabcb7d5b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.223592 Oct 27 01:28:03.920152 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 266/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:03 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:03.927286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-590176b1-c76a-4642-916d-869fa78550de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.203365 Oct 27 01:28:03.927851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:03 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:04.943316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:04.943923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:04.949572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:04.950203 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:04.950496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:04.950981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:04.951418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:04.952140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:04.952554 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:04.952980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:04.956550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:04.957086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:04.957712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:04.958475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:04.959076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:04.959500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:05.147971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:05.150927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:05.156200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-faa45ecb-adf3-4729-aed5-0f456459e489 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.216832 Oct 27 01:28:05.156770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 267/532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:04 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:05.158499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6808b67a-23e1-4f22-a7df-d0ec36846050 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.212686 Oct 27 01:28:05.159054 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:04 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:06.180633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:06.181286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:06.181989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:06.182640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:06.187719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:06.188205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:06.188670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:06.188922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:06.189398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:06.189501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:06.189851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:06.189959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:06.190271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:06.190548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:06.191002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:06.192021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:06.387164 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:06.390310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:06.395586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f3bef668-82f7-4e27-8329-3ae913cedfd8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.219807 Oct 27 01:28:06.396152 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 268/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:06 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:06.398521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c2eca753-083a-4b94-b120-926c98383136 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.220586 Oct 27 01:28:06.399088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:06 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:07.419454 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:07.420054 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:07.421112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:07.421852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:07.427462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:07.428059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:07.428246 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:07.428735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:07.428971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:07.429426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:07.429547 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:07.429880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:07.430109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:07.430300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:07.430553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:07.430972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:07.628598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:07.632222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:07.637901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d281c605-e271-48a6-b117-4cfa0b3158e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.222220 Oct 27 01:28:07.638475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 269/536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:07 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:07.640495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-78f6bd95-2a78-4547-8561-d0c88ebbc509 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.223187 Oct 27 01:28:07.641045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 268/537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:07 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:08.661988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:08.662520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:08.662961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:08.663576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:08.668969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:08.669482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:08.669915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:08.670028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:08.670400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:08.670607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:08.670841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:08.671062 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:08.671483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:08.671581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:08.671974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:08.672405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:09.102997 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:09.115252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:09.118027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0c75d446-1de2-47f0-864e-21e3b47e170f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.460782 Oct 27 01:28:09.118623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 270/538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:08 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:09.139688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c746f5b8-3c87-49c0-ac73-aba23e6b5242 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1368 microversion: 2.1 time: 0.481122 Oct 27 01:28:09.140286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 269/539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:08 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1368 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:10.143085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:10.143608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:10.146261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:10.152610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.153097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.153539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.154218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.154666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.155085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.163117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:10.163720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:10.170056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.170539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.170965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.171651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.172098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.172517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.192309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:10.345360 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:10.353536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c96f2988-10c8-4d62-9d88-10f0a80cea0b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.214314 Oct 27 01:28:10.356583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:10.357313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 271/540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:10 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:10.364439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ad42fdca-d2af-4b70-8cec-a44ae8ae4581 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1559 microversion: 2.1 time: 0.206095 Oct 27 01:28:10.364994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 270/541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:10 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:10.386734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:10.387225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:10.393242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.393656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.394141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.395548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:10.395993 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:10.396414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:10.475007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8c801eb8-9025-4be9-bc90-e4ee734d87de tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092013 Oct 27 01:28:10.475621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 272/542] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:28:10 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:28:11.377021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:11.377692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:11.380296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:11.387387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:11.388481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:11.388481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:11.389204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:11.389984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:11.390302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:11.430853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f4c33b-ade5-4dbc-821f-a0d9273b643f", "tag": "ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:11.441721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:11.442201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:11.442847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:11.455139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] Creating event network-changed:ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9 for instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f on hv-cinder-81558 Oct 27 01:28:11.461808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-45fba4f6-0fdf-4290-b0aa-6abab10a4943 req-be6ba290-cac0-43c0-aee0-4c20b59eecc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034522 Oct 27 01:28:11.463422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 273/543] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:28:11.536189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:11.546251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-288fa897-fd5b-4fb6-a8f7-dcb7a151ed12 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.173091 Oct 27 01:28:11.549087 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 271/544] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:11 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:12.572132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:12.572821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:12.578890 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:12.579375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:12.579804 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:12.580485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:12.580931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:12.581374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:12.601785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:12.721912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:12.731021 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2c847dde-4769-4d9d-bcf5-d8517f360992 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.163630 Oct 27 01:28:12.731584 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 274/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:12 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:13.754828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:13.755457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:13.768834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:13.769370 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:13.769936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:13.770472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:13.770927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:13.771355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:13.907834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:13.917129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ae6439fe-b10e-4147-9517-e15efa97fd80 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.167413 Oct 27 01:28:13.917695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 272/546] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:13 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:14.942426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:14.943117 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:14.949450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:14.949931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:14.950364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:14.951038 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:14.951482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:14.951898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:15.085004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:15.093229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-50402c7e-e273-42c7-8a15-a45b50577a29 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1721 microversion: 2.1 time: 0.155604 Oct 27 01:28:15.093795 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 275/547] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:14 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:16.117222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:16.117747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:16.123617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:16.124095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:16.124529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:16.125242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:16.125716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:16.126140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:16.254971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:16.263161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a6913f47-0ac8-4133-9b59-09d4d9a49faa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1698 microversion: 2.1 time: 0.150051 Oct 27 01:28:16.263724 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 273/548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:16 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1698 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:16.286111 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:16.292436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:16.292912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:16.293381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:16.314719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Going to try to start instance {{(pid=118905) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 01:28:16.355654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-25eccce3-d69b-49a5-880e-f35e3a7aed58 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action" status: 202 len: 0 microversion: 2.1 time: 0.073277 Oct 27 01:28:16.356244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 276/549] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:28:16 2022] POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:28:16.364755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:16.365390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:16.372511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:16.372867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:16.373350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:16.374064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:16.374517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:16.374944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:16.511751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:16.521021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-34062029-2382-4e9b-94d1-951a4e8489b7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1707 microversion: 2.1 time: 0.160414 Oct 27 01:28:16.521828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 274/550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:16 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:28:17.545379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:17.546085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:17.553502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:17.553983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:17.554418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:17.555100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:17.555545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:17.555967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:17.686276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:17.694914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8b7f7ad3-081a-44b7-bed5-877788f5bd01 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1707 microversion: 2.1 time: 0.153813 Oct 27 01:28:17.695487 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 277/551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:17 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:18.728182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:28:18.728828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:18.735267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:18.735750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:18.736186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:18.736871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:18.737357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:18.737787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:18.866566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:28:18.874774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-135cf8bd-0b7d-41a2-b09f-3db92fbae3b3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1711 microversion: 2.1 time: 0.150439 Oct 27 01:28:18.875366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 275/552] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:28:18 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:28:48.014183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6609609b-f6cb-474d-8d8a-6a61adf48a41"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:28:48.016483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:28:48.018686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=13 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:48.019468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:28:48.026614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:48.027096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:48.027560 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:48.028251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:28:48.028699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:28:48.029163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:28:48.294769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a95f82e9-d2bd-4c88-8eee-60fd5f5d9451 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284856 Oct 27 01:28:48.295366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 278/553] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:28:48 2022] POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:01.123529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:01.126443 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:01.128468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=9 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.129136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=32 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.135413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:01.135900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:01.136334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:01.137030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:01.137507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:01.137931 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:01.160851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lazy-loading 'flavor' on Instance uuid 4529e36b-a535-4607-aba5-e545c03b2a06 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:29:01.482408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ed2e6071-71f1-4223-a467-e2693d9e548b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/action" status: 200 len: 32 microversion: 2.1 time: 0.363010 Oct 27 01:29:01.483009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 276/554] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:29:01 2022] POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:29:01.490943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.491711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:01.495739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:01.496445 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:01.503628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:01.504118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:01.504551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:01.505281 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:01.506329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:01.506760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:01.741246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:01.749365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9a1dee0f-9f34-46a5-999f-c5872721c928 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.260526 Oct 27 01:29:01.749940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 279/555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:01 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:02.774271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:02.774993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:02.781050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:02.781545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:02.781972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:02.782648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:02.783092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:02.783511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:02.912314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:02.920382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1c273240-ca2b-4f6b-9061-257f96f0c4b2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.151067 Oct 27 01:29:02.920938 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 277/556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:02 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:03.943593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:03.944198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:03.950627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:03.951104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:03.951538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:03.952222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:03.952669 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:03.953113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:04.086723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:04.094878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ae3f4842-d7af-47a5-a67c-30de70a7e054 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.155194 Oct 27 01:29:04.095453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 280/557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:03 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:05.120122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:05.120649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:05.127026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:05.127505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:05.127942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:05.128628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:05.129098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:05.129526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:05.256421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:05.264564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-42595cd1-60b2-4760-bd57-e8b675c38a06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.148410 Oct 27 01:29:05.265162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 278/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:05 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:06.287858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:06.288446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:06.294859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:06.295325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:06.295760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:06.296435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:06.296888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:06.297331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:06.429758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:06.437840 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5ac96a21-f2f6-4249-8241-470fe7d6988d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.153886 Oct 27 01:29:06.438395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 281/559] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:06 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:07.563595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:07.564207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:07.570493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:07.570970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:07.571401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:07.572078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:07.572527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:07.572946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:07.704017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:07.712994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1cf54a59-176f-4016-a308-454a93d1230a tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.255672 Oct 27 01:29:07.713586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 279/560] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:07 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:08.736778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:08.737386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:08.744540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:08.745013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:08.745475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:08.746179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:08.746621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:08.747037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:08.874914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:08.883619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7219a755-ca54-4673-b26b-082a2871b103 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.150710 Oct 27 01:29:08.884183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 282/561] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:08 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:09.906933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:09.907537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:09.914381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:09.914860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:09.915293 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:09.915981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:09.916425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:09.916848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:10.048268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:10.057295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bd63a691-081f-4085-95a7-62ca8bce6993 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.154214 Oct 27 01:29:10.057852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 280/562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:09 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:11.081441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:11.081984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:11.089020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:11.089527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:11.089961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:11.090634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:11.091080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:11.091495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:11.220646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:11.228943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c4c40ad8-883b-4d29-bfd9-8a0abe8505a1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.151514 Oct 27 01:29:11.229534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 283/563] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:11 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:12.252550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:12.253183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:12.259644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:12.260128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:12.260569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:12.261297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:12.261751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:12.262180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:12.390813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:12.399602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e008fdf5-9004-4940-91f3-42f47dc8e31c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.150901 Oct 27 01:29:12.400154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 281/564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:12 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:13.423150 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:13.423758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:13.431280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:13.431763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:13.432204 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:13.432891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:13.433389 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:13.433813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:13.560918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:13.569104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f7861e79-2d66-4415-b51d-ffcb641e10d9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.149798 Oct 27 01:29:13.569673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 284/565] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:13 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:14.593163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:14.593723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:14.600835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:14.601336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:14.601773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:14.602467 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:14.602918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:14.603375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:14.729291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:14.737387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-95566618-fd54-4abc-b1c6-76de99d7c15b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.148358 Oct 27 01:29:14.737952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 282/566] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:14 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:15.760699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:15.761329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:15.767713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:15.768188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:15.768612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:15.769318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:15.769762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:15.770176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:15.900921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:15.909013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c1a13bee-c566-4070-898e-59006fdb2691 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.152200 Oct 27 01:29:15.909605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 285/567] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:15 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:16.932543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:16.933172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:16.939598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:16.940101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:16.940514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:16.941238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:16.941689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:16.942114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:17.068298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:17.076510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3fe5d491-dd4e-4118-aefc-477fc27ea68e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.147882 Oct 27 01:29:17.077083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 283/568] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:16 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:18.100867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:18.101442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:18.107857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:18.108333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:18.108764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:18.109482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:18.109933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:18.110355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:18.242650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:18.250823 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d0103c75-d132-4c9d-9635-6688492f2131 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.154655 Oct 27 01:29:18.251394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 286/569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:18 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:19.276174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:19.276871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:19.283219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:19.283792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:19.284228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:19.284921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:19.285396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:19.285818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:19.419282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:19.428131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ecb7ef6e-2ab6-4cfd-8448-7f60880b742e tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.155186 Oct 27 01:29:19.428386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 284/570] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:19 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:20.453546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:20.454145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:20.456640 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:29:20.456791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Thu Oct 27 01:29:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 (ip 10.222.0.42) !!! Oct 27 01:29:20.465218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:20.465745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:20.466170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:20.466856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:20.467304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:20.467717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:20.600540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:20.608751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b773de4-350b-4bd4-a63f-1b0248d62e90 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1734 microversion: 2.1 time: 0.159205 Oct 27 01:29:20.609368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 287/571] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:20 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:21.631823 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:21.632434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:21.635472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:29:21.635622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 (ip 10.222.0.42) !!! Oct 27 01:29:21.644214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.644697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:21.645349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:21.646153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.646661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:21.647092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:21.774822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:21.782920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-39b22ce6-a9d6-4ee6-9ded-6b4c87057b06 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1714 microversion: 2.1 time: 0.155094 Oct 27 01:29:21.783473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 285/572] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:21 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:21.844374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:21.844870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:21.851869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.852344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:21.852779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:21.853500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.853951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:21.854375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:21.978632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] HTTP exception thrown: Cannot 'detach_volume' instance 4529e36b-a535-4607-aba5-e545c03b2a06 while it is in vm_state rescued Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Request method failure captured: Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments/6609609b-f6cb-474d-8d8a-6a61adf48a41 HTTP/1.1 Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd22pI394q_8Rabd2tXO0hmcv8ZzBb7T3cMmcksE1CVm9yvjG81r-Lk5wrkUjGyBWCg_S-mnDQuGGWvOk005h-azH9qWW2zIZgsoDYXgBrFtK1gEFAfwqzVOSyLxpOGcRdMZXnIYZPTtisI6dVx5TF2pwWLH_pzlFhjr8oHOb__x3ls Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:29:21.980224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eefe01b108148bab60d4de13be0405d", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: d311fc1f82124819b509f766fa432e2c Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:29:21.981951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Cannot 'detach_volume' instance 4529e36b-a535-4607-aba5-e545c03b2a06 while it is in vm_state rescued Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'server_id': '4529e36b-a535-4607-aba5-e545c03b2a06', 'id': '6609609b-f6cb-474d-8d8a-6a61adf48a41'} Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:29:21.982793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4529e36b-a535-4607-aba5-e545c03b2a06 while it is in vm_state rescued Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4529e36b-a535-4607-aba5-e545c03b2a06 while it is in vm_state rescued Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:21.984273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Returning 409 to user: Cannot 'detach_volume' instance 4529e36b-a535-4607-aba5-e545c03b2a06 while it is in vm_state rescued {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:29:21.985512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0e2fdccc-4a55-4dfe-8e86-a8267aea1b07 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments/6609609b-f6cb-474d-8d8a-6a61adf48a41" status: 409 len: 152 microversion: 2.1 time: 0.141323 Oct 27 01:29:21.985512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 288/573] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:29:21 2022] DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments/6609609b-f6cb-474d-8d8a-6a61adf48a41 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 01:29:21.991321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:21.991856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:21.997890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.998369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:21.998796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:21.999474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:21.999918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:22.000335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:22.065565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-89de2ef7-72e7-48eb-af71-8b66591daccd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/action" status: 202 len: 0 microversion: 2.1 time: 0.078491 Oct 27 01:29:22.066348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 286/574] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:29:21 2022] POST /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:22.076231 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:22.077108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:22.083289 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:22.083785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:22.084282 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:22.084999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:22.085430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:22.085854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:22.215007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:22.223782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-75837c59-9583-4361-84e6-a001a32ca14f tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1722 microversion: 2.1 time: 0.151624 Oct 27 01:29:22.224657 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 289/575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:22 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:23.249652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:23.250365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:23.256776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:23.257291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:23.257737 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:23.258432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:23.258877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:23.259300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:23.406549 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:23.415913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-da69ba76-35a4-456d-ab50-2f5c41617ae1 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1722 microversion: 2.1 time: 0.171249 Oct 27 01:29:23.416492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 287/576] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:23 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:24.439979 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:24.440581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:24.447147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:24.447615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:24.448039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:24.448718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:24.449186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:24.449605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:24.576474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:24.584944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a30af6da-0d56-4080-a737-cdd27bb85360 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1722 microversion: 2.1 time: 0.148795 Oct 27 01:29:24.585530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 290/577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:24 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:25.608895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:25.609566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:25.616070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:25.616557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:25.616997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:25.617715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:25.618172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:25.618600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:25.759267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:25.767708 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0747ee5a-0689-44e8-a7e9-c892c99c4708 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1728 microversion: 2.1 time: 0.162620 Oct 27 01:29:25.768356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 288/578] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:25 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:25.791472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:25.791995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:25.798645 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:25.799221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:25.799687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:25.800386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:25.800840 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:25.801351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:25.878242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-57599250-ac5f-4051-8618-5fe42a4b7bbd tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090651 Oct 27 01:29:25.878842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 291/579] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:29:25 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:26.098907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:26.099475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:26.106526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:26.107018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:26.107454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:26.108168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:26.108612 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:26.109035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:26.169784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:26.240408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lazy-loading 'services' on Instance uuid 6db3be4b-8f81-4b80-8f8d-801378971478 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:29:26.357584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-54788250-b5c6-4c15-bd02-079c018a56e7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments/6d2127df-26ed-4aaa-94ba-e88fbb27dbdb" status: 202 len: 0 microversion: 2.1 time: 0.369285 Oct 27 01:29:26.358309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 289/580] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:29:25 2022] DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments/6d2127df-26ed-4aaa-94ba-e88fbb27dbdb => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:27.064277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:27.076048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:27.076444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:27.076892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:27.092066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] Creating event network-changed:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:29:27.099388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-840fb58d-d986-4c8b-8d4d-26a367f50965 req-68146889-cc78-44c1-8ce5-f33aa0bb10e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111076 Oct 27 01:29:27.103259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 292/581] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:27.494183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:27.502945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:27.503694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:27.504673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:27.570508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Going to try to stop instance {{(pid=118906) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 01:29:27.618632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-584ab845-463f-44c5-9d0c-2548cbd6ce8d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action" status: 202 len: 0 microversion: 2.1 time: 0.128336 Oct 27 01:29:27.619700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 290/582] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:29:27 2022] POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:27.629915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:27.630923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:27.638393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:27.639293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:27.640061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:27.640970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:27.641613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:27.642202 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:27.788755 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:27.797009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-bf7eeabe-66aa-4a4d-94fe-076c273b1ff7 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.172056 Oct 27 01:29:27.797659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 293/583] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:27 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:28.822783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:28.823490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:28.829602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:28.830086 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:28.830527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:28.831214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:28.831668 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:28.832093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:28.964234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:28.972732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0592c166-c648-4219-a7c1-6e43e7bba975 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.154643 Oct 27 01:29:28.973822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 291/584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:28 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:29.114061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:29.123701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:29.124182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:29.124613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:29.135983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] Creating event network-changed:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:29:29.140921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-c0b90781-85b9-4922-a80a-7743a26fcc5b req-27ad093e-8a84-425a-9f2e-4999a9a26a1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 Oct 27 01:29:29.141522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 294/585] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:29.996122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:29.996655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:30.003107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:30.003581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:30.004009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:30.005832 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:30.006283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:30.006706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:30.137131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:30.144717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-05afdb56-192e-4c20-928e-c6c4cea9d4f0 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.152467 Oct 27 01:29:30.145419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 292/586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:29 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:31.167990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:31.168682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:31.175407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:31.175880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:31.176939 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:31.177906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:31.178354 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:31.178775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:31.309848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:31.317994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0bdd8c54-1aa9-445a-bfb9-bf765f0a31ad tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.154227 Oct 27 01:29:31.318560 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 295/587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:31 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:32.341257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:32.341873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:32.344493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=35 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:32.350529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:32.351019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:32.351450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:32.352144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:32.352593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:32.353018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:32.482980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:32.490802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5ae129c0-1e20-4b59-a04f-5334fe1e7d9d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.153462 Oct 27 01:29:32.491365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 293/588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:32 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:33.513757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:33.514374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:33.516802 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=35 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:33.522246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:33.522724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:33.523155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:33.523864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:33.524322 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:33.524741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:33.527315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=93 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:33.652477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:33.660152 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9e2ddf0e-d3dc-4b60-8115-9db8a7ec837b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.150248 Oct 27 01:29:33.661425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 296/589] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:33 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:34.683252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:34.683879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:34.690430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:34.690916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:34.691348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:34.692662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:34.693146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:34.693570 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:34.823912 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:34.831597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d79c8801-1fcd-42c9-9aae-c16e61b6b11d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.152213 Oct 27 01:29:34.832186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 294/590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:34 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:35.854929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:35.855537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:35.862048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:35.862535 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:35.862974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:35.864462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:35.864916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:35.865366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:35.990183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:35.999831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-258f051f-bce0-4e95-94e4-f507a0f278c1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.148776 Oct 27 01:29:36.000403 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 297/591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:35 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:37.022868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:37.023468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:37.029849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:37.030325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:37.030753 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:37.031430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:37.031873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:37.032295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:37.162271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:37.169941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-79accf8a-40f3-4104-ad71-3f4f2780aacc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1675 microversion: 2.1 time: 0.151004 Oct 27 01:29:37.170539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 295/592] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:37 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:38.194144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:38.194751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:38.201108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:38.201587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:38.202014 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:38.202694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:38.203137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:38.203553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:38.329182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:38.337319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9dda1a0d-2635-4d41-88fd-2352af1662ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1652 microversion: 2.1 time: 0.147653 Oct 27 01:29:38.337892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 298/593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:38 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:38.360078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:38.366675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:38.367149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:38.367576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:38.389053 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Going to try to start instance {{(pid=118906) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 01:29:38.429952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ed8f9582-b843-4327-b698-a99b56b6bc1d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action" status: 202 len: 0 microversion: 2.1 time: 0.073570 Oct 27 01:29:38.430633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 296/594] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:29:38 2022] POST /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:29:38.438618 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:38.439213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:38.446028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:38.446487 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:38.447001 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:38.447686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:38.448135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:38.448585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:38.586645 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:38.594436 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6d52f9f9-823c-48e0-b822-225a3b37a69f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1661 microversion: 2.1 time: 0.159604 Oct 27 01:29:38.595000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 299/595] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:38 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:39.119350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:39.119971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:39.126549 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.127040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.127488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.128201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.128656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.129250 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.155791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-480c61db-7950-4a6c-aa15-4e78732c23bc tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/ips" status: 200 len: 151 microversion: 2.1 time: 0.143507 Oct 27 01:29:39.156368 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 297/596] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:29:39 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:39.168978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64dc1d60-eefd-4a11-9719-3e6145580771"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:39.171309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:39.178006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.178493 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.178929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.179630 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.180083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.180516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.261876 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: POST /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/os-volume_attachments HTTP/1.1 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 74 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:29:39.263745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {"volumeAttachment": {"volumeId": "64dc1d60-eefd-4a11-9719-3e6145580771"}} Oct 27 01:29:39.265083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'server_id': 'd7f4c33b-ade5-4dbc-821f-a0d9273b643f', 'body': {'volumeAttachment': {'volumeId': '64dc1d60-eefd-4a11-9719-3e6145580771'}}} Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:39.265881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:39.267261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 400 to user: Invalid volume: volume 64dc1d60-eefd-4a11-9719-3e6145580771 is already attached to instances: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2b9371de-03f3-44fa-a70f-1e18cc034bb5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100131 Oct 27 01:29:39.268851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 300/597] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:29:39 2022] POST /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:29:39.274568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:39.275073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:39.280950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.281470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.281906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.282598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.283061 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.283490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.309797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:29:39.382736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b22481e1-990e-41eb-ae3b-89bd059a1331 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 204 len: 0 microversion: 2.1 time: 0.111660 Oct 27 01:29:39.383451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 298/598] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:29:39 2022] DELETE /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:29:39.391674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:39.392287 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:39.400528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.401011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.401507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.402230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.402710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.403126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.531480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:39.539228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-55ca9a4a-273e-4a6a-9027-a81277052f28 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1684 microversion: 2.1 time: 0.151415 Oct 27 01:29:39.539800 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 301/599] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:39 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:39.617904 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:39.618598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:39.624381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.624861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.625330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.626023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:39.626504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:39.626925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:39.758599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:39.766249 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8448ec14-0c05-4601-a6c6-d112d2ef20aa tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1661 microversion: 2.1 time: 0.152654 Oct 27 01:29:39.766811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 299/600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:39 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:40.562708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:40.563317 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:40.570007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:40.570480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:40.570912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:40.571596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:40.572046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:40.572470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:40.703511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:40.711750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8ac8095b-f721-4ebc-8a69-41843cfaa9bd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1684 microversion: 2.1 time: 0.152972 Oct 27 01:29:40.712316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 302/601] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:40 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:40.794746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:40.795845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:40.808622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:40.809547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:40.810324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:40.811616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:40.812415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:40.813288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:40.948994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:40.956675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bf0e26b8-ca7f-4340-b290-464b852782d1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1661 microversion: 2.1 time: 0.169234 Oct 27 01:29:40.958090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 300/602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:40 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1661 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:41.735618 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:41.736202 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:41.743380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:41.743839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:41.744269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:41.744946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:41.745416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:41.745833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:41.881516 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:41.889193 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2a259536-ddc0-4c80-9dab-2d7bb5692aed tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1684 microversion: 2.1 time: 0.157408 Oct 27 01:29:41.889750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 303/603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:41 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:41.979988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:41.980618 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:41.987048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:41.987468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:41.987908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:41.988669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:41.989167 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:41.989573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:42.119459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:42.127276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ef79e5b5-b391-40d9-b247-07d6458f0a9b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1665 microversion: 2.1 time: 0.151217 Oct 27 01:29:42.127842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 301/604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:41 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:42.722263 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f4c33b-ade5-4dbc-821f-a0d9273b643f", "name": "network-vif-deleted", "tag": "ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:42.736320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:42.736994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:42.737282 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:42.751472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] Creating event network-vif-deleted:ebc3c457-69b7-4b2b-8cdf-35cbbb04b2f9 for instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f on hv-cinder-81558 Oct 27 01:29:42.758398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-40900c93-85e8-4f32-8443-7ca61b15b5ad req-261a2665-fb9c-41d5-b206-32dbcdb6e3ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102829 Oct 27 01:29:42.761232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 304/605] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:42.912552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:42.913313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:42.920575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:42.921170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:42.921858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:42.922786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:42.923445 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:42.924218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:42.930878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:42.961585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:42.962275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:42.962794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:42.963296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid d7f4c33b-ade5-4dbc-821f-a0d9273b643f {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:29:43.021987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:43.031573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-460eb87f-0190-4db7-ad2c-e281ee2022ba tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 200 len: 1332 microversion: 2.1 time: 0.123248 Oct 27 01:29:43.032219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 302/606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:42 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:44.056986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:44.057704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:44.063831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:44.064310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:44.064737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:44.065442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:44.065885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:44.066315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:44.079211 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f HTTP/1.1 Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:29:44.080837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:29:44.082413 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'd7f4c33b-ade5-4dbc-821f-a0d9273b643f'} Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:29:44.083397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:29:44.084963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:29:44.086333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:29:44.086333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e2578f0c-9430-4fb3-90b9-a5e934d391cd tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 404 len: 111 microversion: 2.1 time: 0.030330 Oct 27 01:29:44.086333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 305/607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:44 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:29:44.091373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4b6e3b9f-5fb2-4b02-851a-63aa353f76ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '.version_select at 0x7f6c12f05b80>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:44.114325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4b6e3b9f-5fb2-4b02-851a-63aa353f76ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253702812" status: 202 len: 0 microversion: 2.1 time: 0.026722 Oct 27 01:29:44.114889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 303/608] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 01:29:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253702812 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:44.792312 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:44.792754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:44.798671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:44.799153 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:44.799592 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:44.800285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:44.800816 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:44.801372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:44.882219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'services' on Instance uuid 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:29:44.996393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e1c2c2f6-7a92-493a-8ce0-d7f42173edf9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments/64dc1d60-eefd-4a11-9719-3e6145580771" status: 202 len: 0 microversion: 2.1 time: 0.207847 Oct 27 01:29:44.997073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 306/609] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:29:44 2022] DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments/64dc1d60-eefd-4a11-9719-3e6145580771 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:45.006476 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:45.008746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:45.016493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:45.017242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:45.017658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:45.018684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:45.019217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:45.019742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:45.051130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b7d6a0fc-7405-421f-848d-8dbc0fd41d20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048985 Oct 27 01:29:45.052281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 304/610] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:29:45 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:46.065031 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:46.068826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:46.075267 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.075663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.076233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.076978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.077420 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.077838 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.109223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9bc11728-26df-41a9-bfbd-ffd28b04262a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049077 Oct 27 01:29:46.109775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 307/611] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:29:46 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:29:46.173363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:46.173922 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:46.181240 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.181723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.182162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.182849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.183301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.183725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.207994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:29:46.283481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-db0f96cf-c1ef-48c1-91cd-2aeba527a6f8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 204 len: 0 microversion: 2.1 time: 0.113923 Oct 27 01:29:46.284008 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 305/612] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:29:46 2022] DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:29:46.293629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:46.294233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:46.300079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.300556 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.301672 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.302695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:46.303145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:46.303562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:46.434504 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:46.442718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b9958e7-f5f5-4f6f-8254-fc36e1b3b379 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1682 microversion: 2.1 time: 0.152983 Oct 27 01:29:46.443313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 308/613] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:46 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:47.466631 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:47.467334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:47.473712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:47.474783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:47.475218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:47.475908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:47.476359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:47.476806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:47.609383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:47.617003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c16b6c70-55ba-48ab-bace-e9a972099cd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1682 microversion: 2.1 time: 0.155137 Oct 27 01:29:47.617597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 306/614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:47 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:48.641324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:48.641937 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:48.648326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:48.648810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:48.649283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:48.649973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:48.650423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:48.650844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:48.779744 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:48.787946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-05b67c98-ab13-41ad-9000-9060fc79d026 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1682 microversion: 2.1 time: 0.150621 Oct 27 01:29:48.788709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 309/615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:48 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:29:49.363426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0043e0-d539-46b1-bdd1-8adc22ef0d95", "name": "network-vif-deleted", "tag": "9bbe4643-e570-4c73-9fd9-c977cef6c27c"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:49.376219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:49.376688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:49.377146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:49.390581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] Creating event network-vif-deleted:9bbe4643-e570-4c73-9fd9-c977cef6c27c for instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 on hv-cinder-81558 Oct 27 01:29:49.397154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-bd56c435-3ed4-41ad-9239-5c62795a16f2 req-c60e999f-7d74-4ee8-923d-83c319f0ec6e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036558 Oct 27 01:29:49.398693 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 307/616] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:49.811830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:49.812352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:49.819399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:49.819955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:49.820453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:49.821250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:49.821786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:49.822273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:49.853990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:49.854472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:49.854909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:49.855354 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:29:49.896600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:49.904287 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9c72d3cc-1c6e-4ad8-8a38-8d530ac5b106 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 200 len: 1332 microversion: 2.1 time: 0.096898 Oct 27 01:29:49.904852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 310/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:49 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:50.929166 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:50.929901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:50.936559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:50.937037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:50.937502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:50.938191 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:50.938644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:50.939077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:50.953000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 HTTP/1.1 Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:29:50.954613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:29:50.956141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '7e0043e0-d539-46b1-bdd1-8adc22ef0d95'} Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:29:50.957051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:29:50.958556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:29:50.959691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:29:50.959691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f39b9e99-78dd-4a3d-a341-f7346e143f89 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 404 len: 111 microversion: 2.1 time: 0.031886 Oct 27 01:29:50.959691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 308/618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:50 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:29:50.964884 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-11943e79-5bda-451a-9db4-e7668e17ae31 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '.version_select at 0x7f6c13346af0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:50.985247 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-11943e79-5bda-451a-9db4-e7668e17ae31 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919379818" status: 202 len: 0 microversion: 2.1 time: 0.024091 Oct 27 01:29:50.985806 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 311/619] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 01:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1919379818 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:29:51.594908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-591bd919-f1e9-4c56-9115-0cabfc3cb4b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: .version_select at 0x7f6c12f6c670>, body: {"keypair": {"name": "tempest-keypair-1027197473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqUc9J5000wyBcZsFVDBuWEQfQC+MtpO8Yhc6SjGZSWs5NMfMpc2zkvBjuPsWcOKQQJwbWyzQxP1FWMKAb/CKwh6m5Gassimzsk/7bzoGqctgkdBYiTIanHvFljr1cafw=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:51.610295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-591bd919-f1e9-4c56-9115-0cabfc3cb4b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:29:51.614083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-591bd919-f1e9-4c56-9115-0cabfc3cb4b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:29:51.636332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-591bd919-f1e9-4c56-9115-0cabfc3cb4b4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045186 Oct 27 01:29:51.636935 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 309/620] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:29:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:52.844507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-714713380", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ba9997c-2f90-403d-993a-09c134c8fd7e"}], "security_groups": [{"name": "tempest-securitygroup--92699150"}], "key_name": "tempest-keypair-1027197473", "user_data": "}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:52.949172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] validate_networks() for [('4ba9997c-2f90-403d-993a-09c134c8fd7e', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:29:53.347904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:29:53.348355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:29:53.349370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:29:53.349777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:29:53.350187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:29:53.359120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:53.359598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:53.360033 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:53.360758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:53.361250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:53.361674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:53.378617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:29:53.383090 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:29:53.393879 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:29:53.396824 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:29:53.447100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-37e37026-c142-4c84-abae-e9601ecaba17 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.607317 Oct 27 01:29:53.447745 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 312/621] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:29:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:29:53.460149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1acdfb1b-8a9b-43ee-8a6c-c8e0b7c61305 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:53.460752 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1acdfb1b-8a9b-43ee-8a6c-c8e0b7c61305 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:53.521617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1acdfb1b-8a9b-43ee-8a6c-c8e0b7c61305 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:53.528678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1acdfb1b-8a9b-43ee-8a6c-c8e0b7c61305 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1241 microversion: 2.1 time: 0.073723 Oct 27 01:29:53.529490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 310/622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:53 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:54.552296 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:54.553085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:54.559388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:54.559869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:54.560301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:54.560986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:54.561460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:54.561883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:54.625911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:54.633752 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2709c2bd-086e-47a9-9e06-e1f0bd93af62 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1293 microversion: 2.1 time: 0.085828 Oct 27 01:29:54.634318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 313/623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:54 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:55.657974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:55.658715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:55.669756 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:55.670380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:55.670919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:55.671712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:55.672258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:55.672780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:55.811168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:55.822114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eecc3584-c806-49fb-87de-8cd9a717c228 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.168853 Oct 27 01:29:55.823545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 311/624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:55 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:56.271872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d15b42-2b49-49a1-bfcb-fb3066eec6f9", "tag": "f4266057-9cb1-47f7-82eb-d31f8f4432d7"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:29:56.285467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:56.286484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:56.287172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:56.299368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] Creating event network-changed:f4266057-9cb1-47f7-82eb-d31f8f4432d7 for instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 on hv-cinder-81558 Oct 27 01:29:56.305110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-c3abe6d5-9cc7-4946-8000-f0dbf08fe843 req-c8582a2c-52e5-4aae-8f52-8fb097ce2210 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037267 Oct 27 01:29:56.306343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 314/625] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:29:56.846160 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:56.846854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:56.854836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:56.855392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:56.855828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:56.856522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:56.856970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:56.857448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:56.993483 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:57.001104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f2c973ee-c6da-4830-a831-89b7a35e7c9a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.159087 Oct 27 01:29:57.001672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 312/626] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:56 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:58.025000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:58.025721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:58.031803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:58.032279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:58.032709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:58.033424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:58.033871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:58.034290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:58.049082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:29:58.165842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:58.173293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-16c08fa0-2d26-4a58-82ff-e849031fb88a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.153188 Oct 27 01:29:58.173847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 315/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:58 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:29:59.196378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:29:59.197080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:29:59.203604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:59.204117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:59.204546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:59.205281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:29:59.205754 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:29:59.206343 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:29:59.345689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:29:59.354330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b93d4904-d823-40cf-90f7-8bfaa2ad8a98 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.162426 Oct 27 01:29:59.354905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 313/628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:29:59 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:00.377285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:00.377830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:00.384926 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:00.385435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:00.385874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:00.386568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:00.387018 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:00.387441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:00.517851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:00.526201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b60e3ce-a9e4-4fda-8099-5cfb8e9de70e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.153003 Oct 27 01:30:00.526765 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 316/629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:00 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:01.302730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d15b42-2b49-49a1-bfcb-fb3066eec6f9", "name": "network-vif-plugged", "status": "completed", "tag": "f4266057-9cb1-47f7-82eb-d31f8f4432d7"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:01.312694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:01.313286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:01.314481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:01.327991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] Creating event network-vif-plugged:f4266057-9cb1-47f7-82eb-d31f8f4432d7 for instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 on hv-cinder-81558 Oct 27 01:30:01.333734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-3105310b-b385-4857-9c88-ab1064790898 req-0379d2f7-5881-4ba6-82ea-acf30d225688 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092694 Oct 27 01:30:01.334485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 314/630] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:01.549822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:01.550433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:01.557047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:01.557563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:01.558005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:01.558698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:01.559150 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:01.559579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:01.688232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:01.696818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-34cfc256-153a-4c29-bd22-7bf195abfcdf tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.150890 Oct 27 01:30:01.697421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 317/631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:01 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:02.720237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:02.720967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:02.723949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:02.729369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:02.729879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:02.730314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:02.731013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:02.731462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:02.731886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:02.867822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:02.875418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ceab3707-d339-4623-bf03-bd61a0e29538 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1365 microversion: 2.1 time: 0.159400 Oct 27 01:30:02.875977 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 315/632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:02 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:03.898414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:03.899034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:03.901346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:03.902047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:03.902794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:03.909398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:03.909895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:03.910408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:03.911458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:03.911921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:03.912351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:04.040859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:04.048448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5e5a4852-2f6a-4b3b-8780-6eb5466a3297 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1555 microversion: 2.1 time: 0.154702 Oct 27 01:30:04.049003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 318/633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:03 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:04.071855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:04.072371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:04.074176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:04.079978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:04.080453 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:04.080882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:04.081601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:04.082045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:04.082462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:04.162346 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bc8c26db-225f-49d1-8c50-ccceafcee927 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095143 Oct 27 01:30:04.162942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 316/634] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:30:04 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:30:05.312309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d15b42-2b49-49a1-bfcb-fb3066eec6f9", "tag": "f4266057-9cb1-47f7-82eb-d31f8f4432d7"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:05.327338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:05.327833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:05.328298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:05.341115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] Creating event network-changed:f4266057-9cb1-47f7-82eb-d31f8f4432d7 for instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 on hv-cinder-81558 Oct 27 01:30:05.346286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-2e13407c-4cc3-4fd8-a8fd-32e6239c8297 req-885d5948-cd48-4158-a13b-d7bd75e2965a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037553 Oct 27 01:30:05.346879 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 319/635] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:18.461924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.462750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.466661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:18.467307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:18.474602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:18.475085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:18.475522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:18.476226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:18.476660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:18.477165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:18.500158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lazy-loading 'flavor' on Instance uuid 8f2229ce-290c-40bd-9949-ec88ea4cf9fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:30:18.569335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0f7d28e0-4522-48dc-a456-a900091477b2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "POST /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa/action" status: 202 len: 0 microversion: 2.1 time: 0.108665 Oct 27 01:30:18.569934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 317/636] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:30:18 2022] POST /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:30:18.576197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.577019 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=23 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:18.581253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:18.581950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:18.589850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:18.590329 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:18.590754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:18.591571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:18.592039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:18.592465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:18.727605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:18.735237 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f6b7e484-08f0-42d9-bf63-71cd6e124e84 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.160728 Oct 27 01:30:18.735801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 320/637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:18 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:19.760018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:19.760714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:19.766810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:19.767289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:19.767730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:19.768418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:19.768866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:19.769313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:19.902484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:19.910996 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-20f732aa-c865-4b43-b37e-e4bce50caeb3 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.155067 Oct 27 01:30:19.911639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 318/638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:19 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:20.934308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:20.934954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:20.941377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:20.942480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:20.942911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:20.943598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:20.944054 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:20.944476 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:21.072179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:21.079860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c80151db-296f-4dee-b6d5-4574b9d03a29 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.149487 Oct 27 01:30:21.080425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 321/639] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:20 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:22.103169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:22.103697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:22.110002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:22.110481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:22.110915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:22.111602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:22.112051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:22.112472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:22.240946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:22.248905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ce5c7adc-4968-461f-8096-a86f1bf77884 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.149702 Oct 27 01:30:22.249489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 319/640] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:22 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:23.272528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:23.273173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:23.279827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:23.280306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:23.280742 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:23.281470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:23.281921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:23.282345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:23.423391 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:23.432650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-39b56dbc-ddde-404f-8f5e-89bf2637a288 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.164119 Oct 27 01:30:23.433344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 322/641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:23 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:24.457181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:24.457706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:24.463949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:24.464427 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:24.464911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:24.465698 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:24.466267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:24.466723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:24.597052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:24.604849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7501e8b6-d432-4b0e-b2f3-c524e30ec0eb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.151649 Oct 27 01:30:24.605454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 320/642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:24 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:25.629538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:25.630128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:25.636439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:25.636917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:25.637387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:25.638072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:25.638519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:25.638940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:25.773546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:25.782704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-037bc948-2d0f-4b97-a0c6-faa7603b3304 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.157530 Oct 27 01:30:25.783283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 323/643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:25 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:26.805514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:26.806121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:26.812717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:26.813236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:26.813647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:26.814335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:26.814787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:26.815207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:26.949600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:26.957407 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-528da3c6-9d42-42bb-b6f6-a37f95ffe4ec tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.156536 Oct 27 01:30:26.957967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 321/644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:26 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:27.980352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:27.980946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:27.987481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:27.987951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:27.988683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:27.989182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:27.989627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:27.990044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:28.119921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:28.127627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4e3bc15d-be10-4719-90f0-499ce29e9ac9 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.151146 Oct 27 01:30:28.128191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 324/645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:27 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:29.151406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:29.152009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:29.158991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:29.159466 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:29.160136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:29.161010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:29.161594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:29.162029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:29.298352 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:29.307100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d2c919ff-77f0-463f-95b7-7c78d9ba022a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.159562 Oct 27 01:30:29.307674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 322/646] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:29 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:30.330115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:30.330718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:30.337760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.338262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.338690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.339693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.340146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.340567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.470173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:30.477807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1d82e847-95ac-4624-85a6-02f2f7d0087c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.151593 Oct 27 01:30:30.478363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 325/647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:30 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:30.579879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:30.580422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:30.587213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.587689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.588121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.588798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.589282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.589700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.670705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lazy-loading 'services' on Instance uuid 4529e36b-a535-4607-aba5-e545c03b2a06 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:30:30.740513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9612046f-f1fd-42ff-b035-185b8401cb77 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments/6609609b-f6cb-474d-8d8a-6a61adf48a41" status: 202 len: 0 microversion: 2.1 time: 0.164320 Oct 27 01:30:30.741117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 323/648] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:30:30 2022] DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments/6609609b-f6cb-474d-8d8a-6a61adf48a41 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:30:30.749570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:30.751693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:30.758288 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.759032 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.759472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.760162 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:30.760615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:30.761044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:30.791268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8e6ec31a-e55d-42f3-b7ac-49dec2a8c290 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045625 Oct 27 01:30:30.791806 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 326/649] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:30:30 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:31.502125 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:31.502814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:31.509577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:31.510056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:31.510489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:31.511177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:31.511619 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:31.512036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:31.651179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:31.661495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-14c4f2d9-5659-46f4-a758-01718416098f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.163450 Oct 27 01:30:31.662073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 324/650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:31 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:31.804708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:31.806927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:31.814290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:31.815154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:31.815596 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:31.816691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:31.817285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:31.817710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:31.852012 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-277b15aa-748b-4159-a32a-26f3261d167d tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052000 Oct 27 01:30:31.852567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 327/651] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:30:31 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:32.684636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:32.685266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:32.692221 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.692694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.693162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.693848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.694291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.694710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.823611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:32.831313 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e036a449-324c-4c14-bf20-02bc47caa20e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1506 microversion: 2.1 time: 0.150538 Oct 27 01:30:32.832404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 325/652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:32 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:32.854495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:32.855093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:32.861638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.862124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.862569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.863283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.863737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.864163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.864267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:32.866522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:32.872326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.872802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.873265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.873949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.874396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.874812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.904567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7202e03c-c1f8-48b0-8853-92e2878a4a23 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044680 Oct 27 01:30:32.905158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 326/653] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:30:32 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:30:32.907598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118905) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 01:30:32.976652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f4efe5ea-579e-4699-aa2b-11f4567faf91 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "POST /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa/action" status: 202 len: 0 microversion: 2.1 time: 0.125969 Oct 27 01:30:32.977992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 328/654] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:30:32 2022] POST /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:30:32.985851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:32.986651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:32.989530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:32.990356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:32.993981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.994466 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.994902 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.995603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.996048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.997041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.997182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.997688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.998129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:32.998831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:32.999288 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:32.999738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:33.023165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:30:33.115718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9c11ebec-2e95-4c92-983e-34cccbd24ff8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 204 len: 0 microversion: 2.1 time: 0.133376 Oct 27 01:30:33.117016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 327/655] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:30:32 2022] DELETE /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:30:33.126354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:33.127057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:33.134253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:33.134253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:33.134611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:33.135308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:33.135756 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:33.136184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:33.158501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:33.167832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-86de9a6f-74a1-482f-9ec3-811bd7e05c47 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1514 microversion: 2.1 time: 0.182622 Oct 27 01:30:33.168414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 329/656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:32 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:33.267960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:33.276366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cd5d4148-a662-40e1-a700-e45f945ddf6c tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1688 microversion: 2.1 time: 0.154398 Oct 27 01:30:33.276924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 328/657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:33 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:34.193342 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:34.193959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:34.201452 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:34.201932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:34.202564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:34.203262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:34.203867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:34.204291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:34.299723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:34.300808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:34.308131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:34.308629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:34.309295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:34.309990 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:34.310444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:34.310860 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:34.331212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:34.344536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:34.352356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4bda4338-c8d7-4244-bbf5-79159a49e69c tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1514 microversion: 2.1 time: 0.163750 Oct 27 01:30:34.352925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 330/658] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:34 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:34.459704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:34.467322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2129f276-83a9-4773-9dd1-cca1baa01dcb tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1688 microversion: 2.1 time: 0.171643 Oct 27 01:30:34.467889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 329/659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:34 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:35.361192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "name": "network-vif-unplugged", "status": "completed", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:35.372688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:35.374848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:35.375304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:35.380420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:35.382043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:35.387633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.compute.server_external_events [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] Unable to find a host for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa. Dropping event network-vif-unplugged {{(pid=118905) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 01:30:35.388260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:35.388515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-7da617a5-5a16-4153-8533-8853cfbaa59e req-76e12544-f0da-4aed-a35f-645a0ac4a363 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031446 Oct 27 01:30:35.388738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:35.389120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 331/660] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 01:30:35.389266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:35.389965 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:35.390742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:35.391364 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:35.492053 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:35.492793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:35.499588 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:35.499728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:35.500361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:35.501377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:35.501994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:35.502419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:35.536186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:35.544843 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0e6fb07e-4895-4df6-be24-7bcb94542916 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1514 microversion: 2.1 time: 0.172072 Oct 27 01:30:35.545568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 330/661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:35 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:35.649816 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:35.657715 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-53d77b57-0640-4364-a01b-5846f3ef4623 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1688 microversion: 2.1 time: 0.170395 Oct 27 01:30:35.658283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 332/662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:35 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:36.568361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:36.569042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:36.575414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:36.575904 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:36.576318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:36.577002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:36.577470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:36.577886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:36.682094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:36.682688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:36.689427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:36.689917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:36.690481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:36.691187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:36.691912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:36.692357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:36.707185 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:36.714869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-db82c03a-871e-4170-9446-cf31a95b2119 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1514 microversion: 2.1 time: 0.151089 Oct 27 01:30:36.715437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 331/663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:36 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:36.824348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:36.832245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-76dfe817-5a42-42fa-9268-b2c89f07ce08 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1688 microversion: 2.1 time: 0.153972 Oct 27 01:30:36.832813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 333/664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:36 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:37.541891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4529e36b-a535-4607-aba5-e545c03b2a06", "name": "network-vif-deleted", "tag": "1a854bf3-fbd9-4c18-b187-286a757f049a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:37.551840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.552359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.552786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.563999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] Creating event network-vif-deleted:1a854bf3-fbd9-4c18-b187-286a757f049a for instance 4529e36b-a535-4607-aba5-e545c03b2a06 on hv-cinder-81558 Oct 27 01:30:37.570379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-fc5d7d30-e2b1-44c4-8f7f-d3f385ac699d req-695fc5bd-e0dd-444c-9cd2-346dddbcac1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Oct 27 01:30:37.571530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 332/665] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:37.737621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:37.738823 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:37.752215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.752708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.753172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.753962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.754622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.755051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.863092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:37.864642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:37.872613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.873408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.874089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.875209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.876119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.876748 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.926469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:37.927212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:37.927918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:37.928714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lazy-loading 'fault' on Instance uuid 4529e36b-a535-4607-aba5-e545c03b2a06 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:30:37.986455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:37.991188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:37.995416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e6957a64-8579-4606-8ce3-8c14e6cb2801 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 200 len: 1333 microversion: 2.1 time: 0.143312 Oct 27 01:30:37.996094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 333/666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:37 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 1333 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:37.999131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-565c3f5e-59c9-4188-bd89-bb0fc9e353a2 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1514 microversion: 2.1 time: 0.265293 Oct 27 01:30:37.999938 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 334/667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:37 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:39.018977 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:39.019814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: 4529e36b-a535-4607-aba5-e545c03b2a06] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:39.022739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:39.023339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:39.026315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:39.026864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:39.027363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:39.028116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:39.028670 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:39.029208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:39.029684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:39.030159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:39.030593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:39.031273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:39.031717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:39.032137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:39.043335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] HTTP exception thrown: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Request method failure captured: Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 HTTP/1.1 Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd22pI394q_8Rabd2tXO0hmcv8ZzBb7T3cMmcksE1CVm9yvjG81r-Lk5wrkUjGyBWCg_S-mnDQuGGWvOk005h-azH9qWW2zIZgsoDYXgBrFtK1gEFAfwqzVOSyLxpOGcRdMZXnIYZPTtisI6dVx5TF2pwWLH_pzlFhjr8oHOb__x3ls Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:30:39.044958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eefe01b108148bab60d4de13be0405d", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: d311fc1f82124819b509f766fa432e2c Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. Oct 27 01:30:39.046616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '4529e36b-a535-4607-aba5-e545c03b2a06'} Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:30:39.047491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. Oct 27 01:30:39.048859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:39.050258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Returning 404 to user: Instance 4529e36b-a535-4607-aba5-e545c03b2a06 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:30:39.050258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c6f97845-24c2-4f82-bd89-c573e01caf42 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06" status: 404 len: 111 microversion: 2.1 time: 0.031224 Oct 27 01:30:39.050258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 334/668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:39 2022] GET /compute/v2.1/servers/4529e36b-a535-4607-aba5-e545c03b2a06 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:30:39.055812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-707d5e27-3fcc-437b-86e0-4f3b506402dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '.version_select at 0x7f6c12f2fd30>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:39.074844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-707d5e27-3fcc-437b-86e0-4f3b506402dc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50530738" status: 202 len: 0 microversion: 2.1 time: 0.022434 Oct 27 01:30:39.075340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 335/669] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Oct 27 01:30:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50530738 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:30:39.170867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:39.179162 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f4d418d8-0bcb-480c-8671-de6bc9fe532d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.160820 Oct 27 01:30:39.179955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 335/670] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:39 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:40.203568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:40.204172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:40.212159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:40.212641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:40.213127 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:40.213823 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:40.214274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:40.214705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:40.343359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:40.351865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e5e1c276-558d-4e1c-ac51-01fa48d86d74 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.152451 Oct 27 01:30:40.352420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 336/671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:40 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:41.375078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:41.375682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:41.383355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:41.383834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:41.384269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:41.384955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:41.385478 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:41.385897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:41.389903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:41.518228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:41.525989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a0fa35a7-113f-443e-aae7-2dcb2629ee21 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.154892 Oct 27 01:30:41.526548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 336/672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:41 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:41.961646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:41.962126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:41.968471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:41.968956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:41.969430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:41.970117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:41.970567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:41.970991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:41.998736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:30:42.073155 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-20cf8a50-4d04-42e5-9437-d975996269f9 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 204 len: 0 microversion: 2.1 time: 0.115769 Oct 27 01:30:42.076578 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 337/673] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:30:41 2022] DELETE /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:30:42.083101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:42.083808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:42.090112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:42.090600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:42.091035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:42.091728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:42.092177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:42.092597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:42.224095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:42.231662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-11f234bd-5735-44a8-abdb-97dea38cffc2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1507 microversion: 2.1 time: 0.153771 Oct 27 01:30:42.232220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 337/674] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:42 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:42.551168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:42.552001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:42.557844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:42.558318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:42.558749 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:42.559426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:42.559869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:42.560291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:42.690524 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:42.698735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e162cda2-5f51-4ca4-a58a-3bc9b201d570 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.152195 Oct 27 01:30:42.699296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 338/675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:42 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:43.256716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:43.257346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:43.263841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:43.264320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:43.264751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:43.265464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:43.265916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:43.266365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:43.397837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:43.405442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ed9fa778-fec2-490b-b3a8-609ea17f47cc tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1507 microversion: 2.1 time: 0.153212 Oct 27 01:30:43.406008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 338/676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:43 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:43.723118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:43.723837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:43.730270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:43.730758 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:43.731192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:43.731887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:43.732335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:43.732755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:43.867836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:43.879461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6074a99c-46b2-4026-94c1-642e668bf2ea tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.160645 Oct 27 01:30:43.879994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 339/677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:43 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:44.360358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1923ce-640b-4bc6-b02b-722901af4b9f", "name": "network-vif-deleted", "tag": "a826d83f-2f6e-4c48-b09b-56890b3a069f"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:44.372356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:44.372831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:44.373284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:44.385986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] Creating event network-vif-deleted:a826d83f-2f6e-4c48-b09b-56890b3a069f for instance fb1923ce-640b-4bc6-b02b-722901af4b9f on hv-cinder-81558 Oct 27 01:30:44.391662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-bd25f252-874a-4cfe-8747-a6a3c11516b6 req-bc88ed37-b1db-490e-a716-a530ca88f750 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 Oct 27 01:30:44.392399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 339/678] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:44.431027 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:44.431027 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:44.438740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:44.439302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:44.439811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:44.440707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:44.441784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:44.442625 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:44.504956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:44.512778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5d0ef935-662f-4cd9-a067-d997d279baf0 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 200 len: 1292 microversion: 2.1 time: 0.088344 Oct 27 01:30:44.513373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 340/679] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:44 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:44.903159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:44.903780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:44.911043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:44.911527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:44.911957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:44.912640 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:44.913109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:44.913539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.056950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:45.064925 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d8c904e4-9be8-4294-8d06-6744fda269fe tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.165996 Oct 27 01:30:45.065589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 340/680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:44 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:45.536522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:45.537153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: fb1923ce-640b-4bc6-b02b-722901af4b9f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:45.543557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.544045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.544488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.545209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.545665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.546098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.559921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] HTTP exception thrown: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Request method failure captured: Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f HTTP/1.1 Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd22pI394q_8Rabd2tXO0hmcv8ZzBb7T3cMmcksE1CVm9yvjG81r-Lk5wrkUjGyBWCg_S-mnDQuGGWvOk005h-azH9qWW2zIZgsoDYXgBrFtK1gEFAfwqzVOSyLxpOGcRdMZXnIYZPTtisI6dVx5TF2pwWLH_pzlFhjr8oHOb__x3ls Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:30:45.561562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eefe01b108148bab60d4de13be0405d", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: d311fc1f82124819b509f766fa432e2c Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. Oct 27 01:30:45.563110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'fb1923ce-640b-4bc6-b02b-722901af4b9f'} Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:30:45.563985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. Oct 27 01:30:45.565429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:45.567212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Returning 404 to user: Instance fb1923ce-640b-4bc6-b02b-722901af4b9f could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:30:45.567212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dcc8d296-7d88-4a0b-a36a-9d4e4ab26260 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f" status: 404 len: 111 microversion: 2.1 time: 0.031089 Oct 27 01:30:45.567212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 341/681] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:45 2022] GET /compute/v2.1/servers/fb1923ce-640b-4bc6-b02b-722901af4b9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:30:45.571426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:45.571923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:45.578220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.578704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.579144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.579826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.580278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.580704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.606419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:30:45.688713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3957ca9e-a026-4a2d-92b1-674e25b3a355 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 204 len: 0 microversion: 2.1 time: 0.120576 Oct 27 01:30:45.689484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 341/682] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:30:45 2022] DELETE /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:30:45.699098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:45.699747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:45.705799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.706444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.707516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.708321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.708771 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.709235 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.802355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:45.804633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:45.810663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.811373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.811812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.812509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.812989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.813799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.842299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:45.845686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f22e0695-e297-4c44-8422-9b6291f72a18 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047958 Oct 27 01:30:45.846259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 342/683] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:30:45 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 01:30:45.850490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-805a9b7d-dd91-49a2-817f-2d747e21f7e2 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.155277 Oct 27 01:30:45.851135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 342/684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:45 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:45.912172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:45.912663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:45.918559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.919039 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.919475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.920151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:45.920603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:45.921022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:45.946289 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:30:46.022432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4be23b2d-2d2e-4b88-8cf1-1a1cf4c6f3ec tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 204 len: 0 microversion: 2.1 time: 0.114578 Oct 27 01:30:46.023108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 343/685] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:30:45 2022] DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:30:46.031602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:46.032600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:46.039395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.039895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.040354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:46.041077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.041558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.041976 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:46.089963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:46.090973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:46.099144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.099880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.100387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:46.101264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.101810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.102259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:46.214504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:46.223020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6a800062-ff9b-45bb-bad9-d6e8cea265ae tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1671 microversion: 2.1 time: 0.194894 Oct 27 01:30:46.237404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 343/686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:46 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1671 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:46.260875 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:46.268529 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-39697eed-c6c7-4592-8754-dc975cd6640f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.183784 Oct 27 01:30:46.270078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 344/687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:46 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:46.873880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:46.874580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:46.881182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.881920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.882546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:46.883424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:46.883875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:46.884300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:47.017637 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:47.026063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e42a436c-e308-4ccc-8bd8-5a9ccae14a4b tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.156045 Oct 27 01:30:47.026795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 344/688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:46 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:47.246490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:47.247050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:47.254919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:47.255412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:47.255846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:47.256534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:47.256987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:47.257443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:47.291759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:47.292833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:47.299019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:47.299503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:47.299938 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:47.301674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:47.302132 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:47.302621 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:47.461587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:47.469488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2816c721-3412-4ba1-8087-a34cd93cd64b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1671 microversion: 2.1 time: 0.226845 Oct 27 01:30:47.470671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 345/689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:47 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:47.490815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:47.498674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-826bdb73-122c-4bc0-884e-6d29d7c9d092 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.210789 Oct 27 01:30:47.499375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 345/690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:47 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:48.050270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:48.051199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:48.057195 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.057677 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.058111 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.058798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.059245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.059668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.189610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:48.197679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c99466f7-0cf0-4e4a-9be1-d55931c076b5 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.151370 Oct 27 01:30:48.198241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 346/691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:48 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:48.493582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:48.494198 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:48.496603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:48.501895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.502384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.502821 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.503520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.503973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.504399 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.522772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:48.523373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:48.529627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.530095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.530529 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.531203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:48.531647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:48.532061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:48.712647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:48.715888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:48.716204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:48.721497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-989e7925-0566-4340-a5d6-9cd22a99d64d tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1671 microversion: 2.1 time: 0.231786 Oct 27 01:30:48.722144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 346/692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:48 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:48.724024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e17e8ea4-dbcc-48a8-8def-eef510f9f433 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.206092 Oct 27 01:30:48.724587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 347/693] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:48 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:49.220919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:49.221555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:49.229015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.229522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.229958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.230652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.231103 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.231523 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.362491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:49.371340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-16d18791-5184-4a9b-8f44-d2fd0b25e069 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1522 microversion: 2.1 time: 0.154289 Oct 27 01:30:49.373098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 347/694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:49 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:49.744175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:49.744782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:49.746699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:49.747240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:49.747348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:49.752828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.754646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.755073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.755215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.755560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.755796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.755992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.756245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.756665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.756775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:49.757489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:49.757866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:49.964693 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:49.975763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5705396f-7405-4ce2-a178-19e472348030 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.232800 Oct 27 01:30:49.983472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 348/695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:49 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:30:49.992455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:50.000405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f56ad2db-de13-42ca-88c0-6491657dd7db tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1671 microversion: 2.1 time: 0.260130 Oct 27 01:30:50.001003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 348/696] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:49 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:50.399924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:50.401666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:50.415502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:50.416422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:50.417205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:50.418205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:50.419172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:50.420036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:50.435274 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08e412b-ed93-474b-9f25-0c643550c84c", "name": "network-vif-deleted", "tag": "03b4b398-12c2-4b2b-b9c0-441545a05f75"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:50.452293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:50.453323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:50.454046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:50.469468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] Creating event network-vif-deleted:03b4b398-12c2-4b2b-b9c0-441545a05f75 for instance f08e412b-ed93-474b-9f25-0c643550c84c on hv-cinder-81558 Oct 27 01:30:50.482241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-39713b1f-0faa-473b-9e88-601934813409 req-98eb1cea-2b0d-49e9-b3fc-1aa6a699e104 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047512 Oct 27 01:30:50.483421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 349/697] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:30:50.760994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd311fc1f82124819b509f766fa432e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eefe01b108148bab60d4de13be0405d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:50.768590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9d4036e4-7f57-436c-85c8-8155bb929c45 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 200 len: 1480 microversion: 2.1 time: 0.376173 Oct 27 01:30:50.770236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 349/698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:50 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 1480 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:51.001557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:51.002249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:51.010183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.010926 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.011372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.012696 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.013324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.013624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.025559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:51.026609 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:51.037499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.039556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.040030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.040809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.041332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.041788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.162159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:51.170077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-797a63ca-6325-462c-ab98-41e209f86289 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 200 len: 1603 microversion: 2.1 time: 0.148300 Oct 27 01:30:51.170840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 350/699] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:51 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 1603 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:51.301945 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:51.302980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3be4b-8f81-4b80-8f8d-801378971478", "name": "network-vif-deleted", "tag": "1b044cc4-e3b6-4cc4-8cf5-d225498ee23b"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:51.308084 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:30:51.310622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ad0f643a-f350-46b9-a09a-51b770dbf4df tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.314515 Oct 27 01:30:51.311203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 350/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:50 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:51.343235 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.343819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.344327 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.360594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] Creating event network-vif-deleted:1b044cc4-e3b6-4cc4-8cf5-d225498ee23b for instance 6db3be4b-8f81-4b80-8f8d-801378971478 on hv-cinder-81558 Oct 27 01:30:51.367461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-fcc2944f-9fbe-4adc-9f06-e2c007b800bf req-1061a189-9d08-4f42-9700-a31882901834 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072159 Oct 27 01:30:51.368431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 351/701] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:51.794834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:51.795619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] [instance: f08e412b-ed93-474b-9f25-0c643550c84c] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:51.803657 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.804180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.804665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.805454 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:51.805911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:51.806339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:51.820981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] HTTP exception thrown: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Request method failure captured: Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c HTTP/1.1 Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd22pI394q_8Rabd2tXO0hmcv8ZzBb7T3cMmcksE1CVm9yvjG81r-Lk5wrkUjGyBWCg_S-mnDQuGGWvOk005h-azH9qWW2zIZgsoDYXgBrFtK1gEFAfwqzVOSyLxpOGcRdMZXnIYZPTtisI6dVx5TF2pwWLH_pzlFhjr8oHOb__x3ls Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:30:51.822686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eefe01b108148bab60d4de13be0405d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eefe01b108148bab60d4de13be0405d", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 7eefe01b108148bab60d4de13be0405d Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1482642297 Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: d311fc1f82124819b509f766fa432e2c Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1482642297-project Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. Oct 27 01:30:51.824240 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'f08e412b-ed93-474b-9f25-0c643550c84c'} Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:30:51.825037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. Oct 27 01:30:51.826602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:30:51.827909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] Returning 404 to user: Instance f08e412b-ed93-474b-9f25-0c643550c84c could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:30:51.827909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-43c8a6fc-9322-4846-887e-c37e9e6e8ef8 tempest-ServerRescueNegativeTestJSON-1482642297 tempest-ServerRescueNegativeTestJSON-1482642297-project] 10.222.0.42 "GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c" status: 404 len: 111 microversion: 2.1 time: 0.033489 Oct 27 01:30:51.827909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 351/702] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:51 2022] GET /compute/v2.1/servers/f08e412b-ed93-474b-9f25-0c643550c84c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:30:52.194745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:52.196089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:52.202758 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:52.203498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:52.204705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:52.205620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:52.206836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:52.207448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:52.221565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 HTTP/1.1 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:30:52.223866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:30:52.225457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '6db3be4b-8f81-4b80-8f8d-801378971478'} Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:30:52.226361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:30:52.227622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:30:52.237267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:30:52.238435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ea56e33f-d9ef-4cd9-b886-03d03560742f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 404 len: 111 microversion: 2.1 time: 0.048568 Oct 27 01:30:52.238992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 352/703] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:52 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:30:52.248672 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9247067d-7b12-49b3-ab27-3ff49447c6cb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '.version_select at 0x7f6c12e71a60>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:52.275851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9247067d-7b12-49b3-ab27-3ff49447c6cb tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80468465" status: 202 len: 0 microversion: 2.1 time: 0.031487 Oct 27 01:30:52.276849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 352/704] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Oct 27 01:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80468465 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:30:52.336424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:52.337573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:52.344553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:52.346533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:52.347879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:52.348787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:52.349496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:52.350338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:52.599605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:52.609920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0ac98551-749e-4573-a8f5-abd22806da1d tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.279009 Oct 27 01:30:52.610677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 353/705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:52 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:53.213713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b4be405b-045c-4fba-96f7-36728a5768cc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: .version_select at 0x7f6c12e9e0d0>, body: {"keypair": {"name": "tempest-keypair-755333417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWXyYeT3XxZ2ySpYtq6m5wX9IS1w5RxnhINxOnNds8SxCyQ9t0G3FccGLFhOjq+Ch4xflHYZzntg/U5G4M3a8MPLr6sq22y0AlM1Kw+inV/wrZB97dJAppiTapZv1L0uA=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:53.230736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-b4be405b-045c-4fba-96f7-36728a5768cc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:30:53.235362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-b4be405b-045c-4fba-96f7-36728a5768cc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for user cca36a277e3643a498b27e3c5d5e14f4 and project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:30:53.261851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b4be405b-045c-4fba-96f7-36728a5768cc tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052216 Oct 27 01:30:53.263343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 353/706] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:30:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:53.638043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:53.638629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "name": "network-vif-plugged", "status": "completed", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:53.644946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:53.655105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:53.657760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:53.658204 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:53.663354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:53.664109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:53.664722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:53.665656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:53.666267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:53.666883 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:53.695854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] Creating event network-vif-plugged:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:30:53.716004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-39be856d-9b21-4cba-b55b-2ec0eedde493 req-df79af88-496f-4429-a6b0-ec5fe1c1c551 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081448 Oct 27 01:30:53.717032 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 354/707] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:30:54.380587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:54.388822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7fe4019d-4f26-4ebe-92e5-ee75e980dd76 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.757766 Oct 27 01:30:54.394380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 354/708] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:53 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:55.131770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1208558489", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6bca71c-aea1-476d-8633-0cf730614609"}], "security_groups": [{"name": "tempest-securitygroup--523719379"}], "key_name": "tempest-keypair-755333417", "user_data": "}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:55.254531 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] validate_networks() for [('e6bca71c-aea1-476d-8633-0cf730614609', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:30:55.435165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:55.435840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:55.446801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:55.447299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:55.447746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:55.448460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:55.448917 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:55.449365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:55.734932 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:55.742559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-60047b4a-da66-411c-a1aa-be5c8d8f1475 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1572 microversion: 2.1 time: 0.326523 Oct 27 01:30:55.743129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 355/709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:55 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1572 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:55.775423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:30:55.775525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:30:55.776015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:30:55.776470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:30:55.776900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:30:55.787718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:55.788262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:55.789015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:55.790018 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:55.790612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:55.791641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:55.813342 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:30:55.817902 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Getting quotas for user cca36a277e3643a498b27e3c5d5e14f4 and project 1b1ee6f6a3c3475e8ae993c79ace9166. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:30:55.829458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:30:55.832348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:30:55.884736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0ad0bbf1-cdac-444b-9b45-e0661549cff1 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759189 Oct 27 01:30:55.892381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 355/710] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:30:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:30:55.898193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b0469804-e68a-4912-b6b4-66baef8bfcda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:55.899416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b0469804-e68a-4912-b6b4-66baef8bfcda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:55.984626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b0469804-e68a-4912-b6b4-66baef8bfcda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:55.994106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b0469804-e68a-4912-b6b4-66baef8bfcda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1237 microversion: 2.1 time: 0.100857 Oct 27 01:30:55.995292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 356/711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:55 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:56.767866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:56.768556 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:56.775578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:56.776060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:56.776495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:56.777221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:56.777683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:56.778105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:56.923008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:56.931600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2469670b-4af6-4ad5-8840-e28382a9112e tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1559 microversion: 2.1 time: 0.168535 Oct 27 01:30:56.932167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 356/712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:56 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:57.017520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:57.018198 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:57.025548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:57.026028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:57.026454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:57.027140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:57.027585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:57.028002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:57.098081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:57.129734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b9d16e50-4705-49f9-ba97-29da87e3cd4a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1289 microversion: 2.1 time: 0.097486 Oct 27 01:30:57.130726 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 357/713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:57 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:58.153977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:58.155258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:58.166230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:58.166807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:58.167334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:58.168157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:58.168899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:58.169351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:58.544836 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:30:58.561098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e2c5e5ed-2baf-4faa-bd5b-80fb68822a42 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.410919 Oct 27 01:30:58.561693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 357/714] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:58 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:30:59.510646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e04a9e-c6a7-480b-9da5-abf61d4834ea", "tag": "71d2db25-bcfb-41e4-867a-87753f3dcc33"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:30:59.527725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:59.528288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:59.528786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:59.541511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] Creating event network-changed:71d2db25-bcfb-41e4-867a-87753f3dcc33 for instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea on hv-cinder-81558 Oct 27 01:30:59.547514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-7c708ef8-d728-43d6-bc3d-f9f818522a63 req-1907bd54-8c0c-45b7-bc09-7582a73671e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040548 Oct 27 01:30:59.548165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 358/715] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:30:59.584550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:30:59.585233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:30:59.592534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:59.593027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:59.593493 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:30:59.594230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:30:59.594685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:30:59.595113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:00.171531 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:00.182540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ec856cd2-54fb-446e-89a5-5020fdd71aba tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.602537 Oct 27 01:31:00.194286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 358/716] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:30:59 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:01.208533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:01.209353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:01.216362 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:01.217192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:01.217835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:01.218539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:01.219171 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:01.219601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:01.441213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:01.450175 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7528a292-e4a6-40b1-823e-277a331b3284 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.247453 Oct 27 01:31:01.450757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 359/717] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:01 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:02.474307 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:02.474819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:02.484889 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:02.486661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:02.488089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:02.488861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:02.489510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:02.490104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:02.705384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:02.715101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-98565689-39b1-4d26-a8e1-0838d4198751 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.245409 Oct 27 01:31:02.715839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 359/718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:02 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:02.730603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:31:02.731134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Oct 27 01:31:02.901597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4f7c43a0-aab4-4f02-9c0f-39047c414a1b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: .version_select at 0x7f6c130efee0>, body: {"keypair": {"name": "tempest-keypair-326093205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkkhqLofBJi4EcBEDJoz0sYAH86G9Tp9iaHxkobR3/IMYxf/6P4yQdyEB3O+TvlwqppMbIFh6tRq9Z7F3yrZR8U2zCfjrljR2C4Mnhc28ybxjidwEO2L5gGpX033KvR1A=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:02.923449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-4f7c43a0-aab4-4f02-9c0f-39047c414a1b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for project 73c30908c04242e28297b339bfcc5600. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:31:02.928446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-4f7c43a0-aab4-4f02-9c0f-39047c414a1b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for user 608f1351ab84402d8634ba99b6e26323 and project 73c30908c04242e28297b339bfcc5600. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:31:02.958142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4f7c43a0-aab4-4f02-9c0f-39047c414a1b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.232065 Oct 27 01:31:02.959002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 360/719] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 01:31:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 01:31:03.740476 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:03.741734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:03.750928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:03.751673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:03.752259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:03.753495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:03.754146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:03.754736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:04.063569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:04.082090 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-93a719ad-0784-4a90-9e7d-a26b219ecbf8 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.347417 Oct 27 01:31:04.083262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 360/720] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:03 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:04.526405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1115506674", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8936d5a-77c4-48b0-9095-ed36ec7d5242"}], "security_groups": [{"name": "tempest-securitygroup--153269327"}], "key_name": "tempest-keypair-326093205", "user_data": "}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:04.649715 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] validate_networks() for [('f8936d5a-77c4-48b0-9095-ed36ec7d5242', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:31:05.108066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:05.108831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:05.116457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:31:05.116913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:31:05.117551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:31:05.117956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:31:05.118599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:31:05.120411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:05.120912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:05.122060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:05.122776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:05.123233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:05.123660 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:05.131697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:05.132196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:05.132881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:05.133666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:05.134179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:05.134605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:05.164980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for project 73c30908c04242e28297b339bfcc5600. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:31:05.171303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for user 608f1351ab84402d8634ba99b6e26323 and project 73c30908c04242e28297b339bfcc5600. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:31:05.193584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:31:05.196391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:31:05.271157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2437967d-dbfe-4b15-ae93-a64eb7bb44a6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.749691 Oct 27 01:31:05.275484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 361/721] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 01:31:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 01:31:05.300894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:05.303121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:05.303988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:05.328198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-39ab5034-0636-4659-aa00-5e1082bef768 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.225377 Oct 27 01:31:05.335762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 361/722] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:05 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:05.412845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:05.426633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:05.428333 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:05.429582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7fb77c31-cd1d-46f7-a41a-de184590717e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1281 microversion: 2.20 time: 0.141588 Oct 27 01:31:05.446597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 362/723] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:05 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:06.363131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:06.363770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:06.369973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:06.370653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=10 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:06.383352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:06.387367 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:06.388885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:06.391122 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:06.391771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:06.392212 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:06.464209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:06.464852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:06.478380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:06.479227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:06.479935 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:06.480969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:06.481605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:06.482265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:06.588130 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:06.602626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:06.604333 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:06.605520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d26ac0f7-8141-470b-ba23-5f8799d68424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1333 microversion: 2.20 time: 0.151622 Oct 27 01:31:06.621466 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 363/724] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:06 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:06.622089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:06.634385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-79fed43a-0e1e-4701-b616-57ad0306f99c tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.277370 Oct 27 01:31:06.635346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 362/725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:06 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:07.587141 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e04a9e-c6a7-480b-9da5-abf61d4834ea", "name": "network-vif-plugged", "status": "completed", "tag": "71d2db25-bcfb-41e4-867a-87753f3dcc33"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:07.605737 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:07.606491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:07.607091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:07.624699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] Creating event network-vif-plugged:71d2db25-bcfb-41e4-867a-87753f3dcc33 for instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea on hv-cinder-81558 Oct 27 01:31:07.636362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:07.637716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:07.646099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-aea84612-7358-49a8-bcf6-32a5336326b7 req-9f653447-e603-4c3d-af0b-0d08a9ddc175 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072407 Oct 27 01:31:07.649116 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:07.649923 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 364/726] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:07.650575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:07.651199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:07.653656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:07.658644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:07.661666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:07.665517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:07.666451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:07.677945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:07.685713 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:07.686394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:07.687294 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:07.687906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:07.688498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:07.854688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:07.869151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:07.872590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:07.873898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-70aca9aa-e3e6-4037-8c0f-d9d3932f85e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1339 microversion: 2.20 time: 0.242080 Oct 27 01:31:07.875082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 363/727] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:07 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:07.964905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:07.976733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-79c490fe-ca9d-4e18-9a09-fdb4105720ab tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.321166 Oct 27 01:31:07.994021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 365/728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:07 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:08.903996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:08.905270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:08.914154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:08.914874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:08.915303 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:08.916006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:08.916453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:08.916908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:09.003973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:09.004653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:09.012817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:09.013402 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:09.013841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:09.014795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:09.015253 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:09.015712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:09.211961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:09.221494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:09.223285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:09.225173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9ddebc31-9081-4173-bab7-a57bf0d2cb3f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.325508 Oct 27 01:31:09.225892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 364/729] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:08 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:09.294601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:09.304608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c1176837-b660-4d60-b132-1cba16637e11 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1362 microversion: 2.1 time: 0.305933 Oct 27 01:31:09.309118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 366/730] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:08 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:31:09.457338 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:09.468415 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:09.468754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:09.470304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:09.482668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] Creating event network-changed:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:31:09.488389 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-ebcd1e6b-f95c-405a-b461-c119a5115034 req-97fd8571-febc-4d34-8376-1c90996d5f41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035322 Oct 27 01:31:09.488983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 365/731] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:10.251206 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:10.251817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:10.260261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.260743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.261365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.262060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.262512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.262930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.329035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:10.331785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:10.340880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.341217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.341837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.342548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.342996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.343416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.543608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:10.554147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:10.555827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:10.560002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-09623f70-7b7a-49bc-b6a7-0eeb1baa17ec tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.313252 Oct 27 01:31:10.561030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 367/732] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:10 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:10.598734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:10.609379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-430c2836-d71f-479b-aff6-b69f19d6d189 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1548 microversion: 2.1 time: 0.285175 Oct 27 01:31:10.610885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 366/733] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:10 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:31:10.638598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:10.639114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:10.646089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.646586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.647012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.647709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:10.648158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:10.648608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:10.732686 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-3115bc7e-1459-44b5-9cd1-3189a079bdac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099182 Oct 27 01:31:10.733354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 368/734] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:31:10 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:11.587209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:11.588402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:11.600735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:11.601525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:11.602137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:11.603029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:11.603643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:11.604076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:11.706090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e04a9e-c6a7-480b-9da5-abf61d4834ea", "tag": "71d2db25-bcfb-41e4-867a-87753f3dcc33"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:11.717479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:11.718035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:11.718742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:11.732118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] Creating event network-changed:71d2db25-bcfb-41e4-867a-87753f3dcc33 for instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea on hv-cinder-81558 Oct 27 01:31:11.737308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-5c1623cc-dd61-42ac-a9ad-ba14772e88d8 req-2b0fc2fc-3955-464d-8d9d-b09f38ffb32c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035562 Oct 27 01:31:11.738501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 369/735] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:11.797379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:11.806064 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:11.807508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:11.808658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0f969ab3-955c-43ad-9b1c-1653ef4d1c46 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.226434 Oct 27 01:31:11.809627 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 367/736] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:11 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:12.837805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:12.838513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:12.847284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:12.847770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:12.848252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:12.849162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:12.849920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:12.850556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:13.094839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:13.099716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:13.106455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:13.108122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:13.109886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1d87d6e8-47e0-42b0-bc58-3fe171d4eec6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.278968 Oct 27 01:31:13.110441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 370/737] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:12 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:14.136254 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:14.136869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:14.143689 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:14.144163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:14.144593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:14.145297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:14.145747 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:14.146164 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:14.273915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:14.281837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:14.283269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:14.285448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3bde5826-3fca-407d-a34b-b5cd53069521 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.153016 Oct 27 01:31:14.286002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 368/738] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:14 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:15.311144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:15.311753 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:15.313713 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:15.319897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:15.320372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:15.320801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:15.321509 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:15.321960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:15.322378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:15.419588 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=14 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:15.449971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:15.458179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:15.459610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:15.460744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9b6a2fce-9ee7-46ca-91ba-cfb2f5296766 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.153725 Oct 27 01:31:15.461327 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 371/739] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:15 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:16.486283 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:16.487334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:16.494161 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:16.494639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:16.495069 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:16.495748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:16.496202 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:16.496617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:16.628928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:16.636810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:16.638327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:16.639412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7e477374-02c0-4554-b29d-7d33b98731d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.157068 Oct 27 01:31:16.639957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 369/740] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:16 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:17.569634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "name": "network-vif-plugged", "status": "completed", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:17.580931 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:17.581722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:17.582173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:17.593341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] Creating event network-vif-plugged:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:31:17.598231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-43d79398-9a11-4587-ab8b-a169b60fbede req-02af5063-4911-4902-87e5-232fead98f9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Oct 27 01:31:17.599021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 372/741] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:17.664989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:17.665559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:17.671940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:17.672422 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:17.672859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:17.673591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:17.674548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:17.674985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:17.839531 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:17.848607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:17.850098 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:17.851205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-42e366d5-b349-4789-a6ac-48f37ef09c84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.190326 Oct 27 01:31:17.851772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 370/742] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:17 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:18.876769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:18.878139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:18.880891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:18.886586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:18.887042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:18.887472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:18.888152 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:18.888596 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:18.889011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:19.016452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:19.025240 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:19.026685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:19.027792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7a58ff9a-9ca2-4a8e-9804-4409e9f4786d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1406 microversion: 2.20 time: 0.155335 Oct 27 01:31:19.028349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 373/743] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:18 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:20.052424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:20.053047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:20.055326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:20.060363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.060837 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.061295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.061970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.062412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.062825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.195260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:20.203183 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:20.204615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:20.206930 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-61f9b2bd-e34e-47f0-a94e-29ddec145e78 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1597 microversion: 2.20 time: 0.159115 Oct 27 01:31:20.207497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 371/744] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:31:20 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:31:20.231574 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:20.232087 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:20.239031 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.239510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.239943 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.240624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.241081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.241506 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.321456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fb2a518c-7a2c-4303-bba8-ef5336a19581 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093745 Oct 27 01:31:20.322052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 374/745] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 01:31:20 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:31:20.453996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:20.454490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:20.461582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.462072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.462507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.463213 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:20.463673 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:20.464094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:20.468231 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=100 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:20.489629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4e0a6eef-7508-4f58-9ac7-2b302a0dd392 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.039396 Oct 27 01:31:20.490218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 372/746] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:31:20 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:21.517764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:21.526954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:21.527427 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:21.527859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:21.539050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] Creating event network-changed:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:31:21.543876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-dd39ca13-b9f9-4b3a-b6f3-5f2baf3f2870 req-112950e5-d65c-4820-97b5-8c510d3c1f86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030535 Oct 27 01:31:21.544521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 375/747] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:21.842889 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe0ec93-123d-46a2-a36b-5ce49646b4fb"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:21.845251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:21.853221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:21.853998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:21.854639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:21.855567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:21.856220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:21.856839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:22.168330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0310c451-9306-431e-985e-069372a66e96 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329253 Oct 27 01:31:22.168949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 373/748] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:31:21 2022] POST /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:31:29.724960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fe0ec93-123d-46a2-a36b-5ce49646b4fb"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:29.727360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:29.733415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:29.733889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:29.734318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:29.734998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:29.735441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:29.735907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:29.813816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: POST /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments HTTP/1.1 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 74 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:31:29.815705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {"volumeAttachment": {"volumeId": "0fe0ec93-123d-46a2-a36b-5ce49646b4fb"}} Oct 27 01:31:29.817383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'server_id': '98d15b42-2b49-49a1-bfcb-fb3066eec6f9', 'body': {'volumeAttachment': {'volumeId': '0fe0ec93-123d-46a2-a36b-5ce49646b4fb'}}} Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:29.818903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:29.820378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 400 to user: Invalid volume: volume 0fe0ec93-123d-46a2-a36b-5ce49646b4fb is already attached to instances: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2653ae31-038c-4202-9c14-64bbb09a906d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097904 Oct 27 01:31:29.822620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 376/749] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:31:29 2022] POST /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:31:29.883887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:29.884473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:29.890591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:29.891068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:29.891505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:29.892691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:29.893161 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:29.893594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:29.974963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'services' on Instance uuid 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:31:30.045358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b63e3161-1c99-4d1d-a9d1-b753f29ec69d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments/0fe0ec93-123d-46a2-a36b-5ce49646b4fb" status: 202 len: 0 microversion: 2.1 time: 0.166137 Oct 27 01:31:30.046009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 374/750] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:31:29 2022] DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments/0fe0ec93-123d-46a2-a36b-5ce49646b4fb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:31:30.055742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:30.057979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:30.066474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:30.068099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:30.068559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:30.069464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:30.069916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:30.070336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:30.100805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-18ba30c9-a68c-4842-beb5-6988994ebe53 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050298 Oct 27 01:31:30.101400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 377/751] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:31:30 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:31.114739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:31.117236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:31.123301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.123774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.124205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.124879 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.125350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.125764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.154751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b542753-1df4-420d-851b-794a3f0406d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045365 Oct 27 01:31:31.155290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 375/752] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:31:31 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:31:31.219134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:31.219658 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:31.226692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.227167 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.227598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.228279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.228724 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.229179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.253734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:31:31.327271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5861abb0-f7ec-4b2a-8f4b-72385da78fe3 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 204 len: 0 microversion: 2.1 time: 0.111562 Oct 27 01:31:31.327866 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 378/753] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:31:31 2022] DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:31:31.337867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:31.338491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:31.344825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.345993 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.346488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.347256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:31.347854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:31.348210 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:31.482357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:31.490347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1b5f8f28-8214-4514-9ee2-dccdfdcdd24c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1679 microversion: 2.1 time: 0.157434 Oct 27 01:31:31.490908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 376/754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:31 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:32.515289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:32.515818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:32.523056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:32.523530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:32.523955 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:32.524696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:32.525289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:32.525855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:32.656056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:32.663721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ff7a7ea0-c284-4d4c-9bec-155341613bf0 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1679 microversion: 2.1 time: 0.152836 Oct 27 01:31:32.664277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 379/755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:32 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:33.687304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:33.687898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:33.694843 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:33.695319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:33.695750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:33.696430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:33.696881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:33.697327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:33.904002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:33.911693 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-893f23df-3e3c-49c5-8470-5c2ab9462bfb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1679 microversion: 2.1 time: 0.228198 Oct 27 01:31:33.912262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 377/756] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:33 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:34.594739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d15b42-2b49-49a1-bfcb-fb3066eec6f9", "name": "network-vif-deleted", "tag": "f4266057-9cb1-47f7-82eb-d31f8f4432d7"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:34.606754 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:34.607370 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:34.607808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:34.620129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] Creating event network-vif-deleted:f4266057-9cb1-47f7-82eb-d31f8f4432d7 for instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 on hv-cinder-81558 Oct 27 01:31:34.625107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-efae2db1-27da-4e56-9bdc-7ad413beb0c6 req-bbece4f4-3c63-46db-955c-5ec551580755 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034130 Oct 27 01:31:34.626038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 380/757] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:34.935620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:34.936326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:34.943086 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:34.943552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:34.943982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:34.944657 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:34.945120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:34.945539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:34.978315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:34.978786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:34.979215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:34.979653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:31:35.023256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:35.031092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e3eb781c-c9c0-47e3-89b6-0c2afc5edd16 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 200 len: 1331 microversion: 2.1 time: 0.099332 Oct 27 01:31:35.031847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 378/758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:34 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:36.056353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:36.057047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:36.063118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:36.063608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:36.064255 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:36.065071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:36.065531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:36.065949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:36.079071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 HTTP/1.1 Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:31:36.080903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:31:36.082468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '98d15b42-2b49-49a1-bfcb-fb3066eec6f9'} Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:31:36.083383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:31:36.084834 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:31:36.086192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:31:36.086192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8e9f36dd-9cac-4ca9-bee0-fe5dcfa1ad20 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 404 len: 111 microversion: 2.1 time: 0.030670 Oct 27 01:31:36.086192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 381/759] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:36 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:31:36.091415 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5ea97361-84e1-45b7-a5f4-66dfa09c744a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '.version_select at 0x7f6c12e71280>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:36.109901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5ea97361-84e1-45b7-a5f4-66dfa09c744a tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027197473" status: 202 len: 0 microversion: 2.1 time: 0.022283 Oct 27 01:31:36.110442 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 379/760] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 01:31:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027197473 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:31:36.945950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0d07aa9d-c74b-45b1-bbb4-398875e88628 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: .version_select at 0x7f6c12f2f1f0>, body: {"keypair": {"name": "tempest-keypair-1302923156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4/p3LbPZHGq3WKAdqpIIA53uW/c8ICrlyjXbG415W1Se5Tng65oESKoviHW44II3cbY0TfNSQtwu/DGOmYiQvazwS81loZTHxy+V6ChkbCp/CLp3LQYc95yuOZWdxTFQ=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:36.961375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-0d07aa9d-c74b-45b1-bbb4-398875e88628 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:31:36.965172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-0d07aa9d-c74b-45b1-bbb4-398875e88628 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:31:36.986286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0d07aa9d-c74b-45b1-bbb4-398875e88628 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044072 Oct 27 01:31:36.986873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 382/761] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:38.243537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1400278055", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ba9997c-2f90-403d-993a-09c134c8fd7e"}], "security_groups": [{"name": "tempest-securitygroup--372309613"}], "key_name": "tempest-keypair-1302923156", "user_data": "}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:38.348071 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] validate_networks() for [('4ba9997c-2f90-403d-993a-09c134c8fd7e', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:31:38.713460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:31:38.713894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:31:38.714364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:31:38.714772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:31:38.715191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:31:38.723936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:38.724416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:38.724850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:38.725619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:38.726075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:38.726498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:38.743228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:31:38.747124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Getting quotas for user 99bcd22ff73b4526a54cf0e76f509436 and project db70dacc270d431182451b57b277484f. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:31:38.758599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:31:38.760858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:31:38.807817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4edf022b-c5cf-40b1-bcf1-4a5f01b861d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568995 Oct 27 01:31:38.808463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 380/762] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:31:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:31:38.820955 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-657ea409-4320-4603-b8b9-adbbbebebbbb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:38.821677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-657ea409-4320-4603-b8b9-adbbbebebbbb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:38.878354 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-657ea409-4320-4603-b8b9-adbbbebebbbb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:38.885318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-657ea409-4320-4603-b8b9-adbbbebebbbb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1242 microversion: 2.1 time: 0.068137 Oct 27 01:31:38.885736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 383/763] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:38 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:39.908043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:39.908648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:39.916628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:39.917278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:39.917732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:39.918519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:39.919136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:39.919553 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:39.984280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:39.992517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8bc13bff-c134-4033-9808-7ab683ceda5c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1294 microversion: 2.1 time: 0.088870 Oct 27 01:31:39.993137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 381/764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:39 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:41.015910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:41.016431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:41.023375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:41.023868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:41.024307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:41.025011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:41.025493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:41.025930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:41.223708 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:41.231415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d1503b84-ae33-4695-b600-aa9d2fe72979 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.219557 Oct 27 01:31:41.231975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 384/765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:41 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:41.538078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e95155-e929-4282-ac51-d3b872f832fa", "tag": "311d6690-3b36-4df2-b7a5-5b40b0331297"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:41.552656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:41.553361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:41.553899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:41.566801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] Creating event network-changed:311d6690-3b36-4df2-b7a5-5b40b0331297 for instance 62e95155-e929-4282-ac51-d3b872f832fa on hv-cinder-81558 Oct 27 01:31:41.571633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-6d31d60d-83b7-4bc4-b3cb-f660aa52b61f req-718a6efe-7f2b-4d0d-9307-d8d0c7a0fc39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038400 Oct 27 01:31:41.572223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 382/766] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:31:42.255514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:42.256121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:42.263517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:42.263992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:42.264423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:42.265138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:42.265585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:42.266004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:42.395533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:42.403144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4dfde76b-e654-4c55-b5bd-84bbc2ec737e tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.151474 Oct 27 01:31:42.403700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 385/767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:42 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:43.427912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:43.428614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:43.434763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:43.435248 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:43.435688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:43.436374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:43.436827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:43.437294 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:43.570529 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:43.578225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c0273b35-7f02-44e3-adcc-4a8f0dc931ea tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.155681 Oct 27 01:31:43.578786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 383/768] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:43 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:44.600187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:44.600777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:44.607662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:44.608138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:44.608567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:44.609274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:44.609719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:44.610136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:44.819193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:44.826840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0a14b047-63a2-4f17-888b-f65ee27d8f67 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.230677 Oct 27 01:31:44.827393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 386/769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:44 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:45.850096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:45.850709 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:45.857145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:45.857626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:45.858059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:45.858742 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:45.859190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:45.859611 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:45.985851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:45.993999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5fc540c5-19a7-4c49-a95e-48c9e70272eb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.147807 Oct 27 01:31:45.994557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 384/770] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:45 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:47.016941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:47.017584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:47.024166 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:47.024652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:47.025119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:47.025845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:47.026300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:47.026731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:47.029393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:47.161853 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:47.169386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6b275eda-0806-4c0b-8254-af96c0dd58b9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.156297 Oct 27 01:31:47.169941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 387/771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:47 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:47.728300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e95155-e929-4282-ac51-d3b872f832fa", "name": "network-vif-plugged", "status": "completed", "tag": "311d6690-3b36-4df2-b7a5-5b40b0331297"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:47.738461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:47.738916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:47.739344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:47.751023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] Creating event network-vif-plugged:311d6690-3b36-4df2-b7a5-5b40b0331297 for instance 62e95155-e929-4282-ac51-d3b872f832fa on hv-cinder-81558 Oct 27 01:31:47.756145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-93d560c5-feed-4bc0-aa70-ec44eb279fa6 req-8991f252-dcbb-46ea-bac7-ccbb7600a7cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Oct 27 01:31:47.756731 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 385/772] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:48.193267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:48.193809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:48.200165 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:48.200639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:48.201097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:48.201787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:48.202237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:48.202659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:48.330010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:48.338123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e5fc25e5-6316-470c-816a-5bb07bc7dccb tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.148911 Oct 27 01:31:48.338681 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 388/773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:48 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:49.358304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:49.359605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:49.364094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:49.364796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:49.371912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:49.372340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:49.372778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:49.373497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:49.373952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:49.374377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:49.516986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:49.524801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f09ee600-ceeb-486b-88a2-4ca7f967c173 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1367 microversion: 2.1 time: 0.167540 Oct 27 01:31:49.525384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 386/774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:49 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:50.547100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:50.547714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:50.550053 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:50.551156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:50.557001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:50.557511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:50.557947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:50.558638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:50.559093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:50.559541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:50.688581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:31:50.696779 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ee4c2481-f5aa-4f2d-b960-3134270e0f42 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1557 microversion: 2.1 time: 0.153555 Oct 27 01:31:50.697382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 389/775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:31:50 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:31:50.721136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:31:50.722265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:31:50.724702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:50.730754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:50.731313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:50.731794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:50.732559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:50.733044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:50.733530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:50.736400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:31:50.817851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a92618e-599f-4df0-bf2f-6ecf1e9e94c7 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100715 Oct 27 01:31:50.818764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 387/776] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Oct 27 01:31:50 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:31:51.725420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e95155-e929-4282-ac51-d3b872f832fa", "tag": "311d6690-3b36-4df2-b7a5-5b40b0331297"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:31:51.735281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:31:51.735762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:31:51.736213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:31:51.747675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] Creating event network-changed:311d6690-3b36-4df2-b7a5-5b40b0331297 for instance 62e95155-e929-4282-ac51-d3b872f832fa on hv-cinder-81558 Oct 27 01:31:51.752566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-ccb2c8b4-4529-459c-8872-e34f10e6e302 req-e5bcdbef-4e10-4d87-91de-c94c07e85b7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031394 Oct 27 01:31:51.753196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 390/777] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:29.793021 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:29.793782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:29.798026 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:29.798509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:29.809589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:29.810080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:29.810513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:29.811207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:29.811654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:29.812071 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:29.836910 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-08583a11-b3d0-421a-ade8-f01c0f870c69 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/ips" status: 200 len: 145 microversion: 2.1 time: 0.045534 Oct 27 01:32:29.837499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 388/778] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:32:29 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:32:31.164074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:31.164903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=19 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:31.169332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92337809-1aa9-4143-9f36-aae0e272832f"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:31.171706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:31.179197 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:31.179675 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:31.180108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:31.180796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:31.181332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:31.181761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:31.447953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-87d0b3c1-eb95-41c3-9a63-74d13419838b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285103 Oct 27 01:32:31.448561 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 391/779] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:32:31 2022] POST /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:32:34.197139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:34.197682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:34.201451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:34.204343 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:34.204970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:34.205827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:34.206899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:34.207438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:34.208177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:34.212901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:34.213599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:34.214025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:34.224998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] Creating event network-changed:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:32:34.229980 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-7244e685-eb01-4cec-a992-04f1a1d0cd08 req-624a201e-6d73-4f8b-8877-29048745eb46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039782 Oct 27 01:32:34.230575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 392/780] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:34.238617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:32:34.321785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-49e395e3-1c05-4ea0-a671-3c6cc9a04f61 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 204 len: 0 microversion: 2.1 time: 0.133860 Oct 27 01:32:34.322638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 389/781] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:32:34 2022] DELETE /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:32:34.332449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:34.333473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:34.340016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:34.340496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:34.340929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:34.341651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:34.342098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:34.342517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:34.479916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:34.487564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f710c6b5-56ea-454e-b4d4-c78e2a59d27f tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.159931 Oct 27 01:32:34.488221 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 393/782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:34 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:35.513131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:35.513982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:35.521085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:35.521582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:35.522017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:35.522695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:35.523140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:35.523556 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:35.944970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:35.952591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d4b27305-5378-4ad1-acd1-7044c0783422 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1565 microversion: 2.1 time: 0.443920 Oct 27 01:32:35.953182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 390/783] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:35 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1565 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:36.663099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:36.663634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:36.669918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:36.670403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:36.670844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:36.671538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:36.671991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:36.672522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:36.696219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c9d0dc29-4cd6-4e37-b6b8-6d6f535995e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/ips" status: 200 len: 151 microversion: 2.20 time: 0.037613 Oct 27 01:32:36.696793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 394/784] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Oct 27 01:32:36 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:32:36.976599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2229ce-290c-40bd-9949-ec88ea4cf9fa", "name": "network-vif-deleted", "tag": "4d69ceff-443c-464b-8f81-6dc73cdbb4da"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:36.979755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:36.980875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:36.986620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:36.987066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:36.987489 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:36.996238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:36.996740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:36.997209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:36.997919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:36.998375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:36.998807 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:37.001352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] Creating event network-vif-deleted:4d69ceff-443c-464b-8f81-6dc73cdbb4da for instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa on hv-cinder-81558 Oct 27 01:32:37.007186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-50cb7aac-bbd4-4744-a5b7-5d2598a348a5 req-f7d5031a-13f4-4aab-906b-74debef13484 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034914 Oct 27 01:32:37.007844 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 391/785] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:37.090933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:37.100385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b90e9a34-37b0-47e0-bc33-a4c63f18eeb6 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1218 microversion: 2.1 time: 0.124165 Oct 27 01:32:37.101386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 395/786] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:36 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:38.125264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:38.125972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:38.132118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:38.132719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:38.133239 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:38.134003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:38.134474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:38.134899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:38.199120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '181df03f4bba4f96afc3c888b3ca9b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ecdf4e71844f7f9e3da7f59659b605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:38.208204 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-005b1008-8a0e-4171-910d-8f9110eab06a tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 200 len: 1218 microversion: 2.1 time: 0.087640 Oct 27 01:32:38.208932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 392/787] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:38 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:32:39.004212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:39.006560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:39.012954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.013459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.013893 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.014631 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.015078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.015497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.044730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-76624934-d089-4b82-bff9-9d0279d12dda tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Oct 27 01:32:39.045297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 396/788] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:32:38 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:39.056530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:39.057023 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:39.062933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.063411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.063846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.064528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.064977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.065425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.094523 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-cf10a6c9-83b3-42cb-b71b-624eecbd8a57 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f" status: 200 len: 194 microversion: 2.1 time: 0.042053 Oct 27 01:32:39.095101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 393/789] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 01:32:39 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:39.168655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:39.169223 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:39.175770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.176303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.176779 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.177497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.177943 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.178360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.202790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lazy-loading 'flavor' on Instance uuid b414d9ca-9bc2-4101-953a-4f866cf4326f {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:32:39.234374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:39.235568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] [instance: 8f2229ce-290c-40bd-9949-ec88ea4cf9fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:39.244489 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.245178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.245559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.246391 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.246929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.247325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.262826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] HTTP exception thrown: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Request method failure captured: Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa HTTP/1.1 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd4qs5t66f0pkfErheTcOndFbClgGaQm_R76izWaxqvyfzfM1_Tci5nIIug9oX8-A9WuEOQPmH0Jp0vPo8nUwW_cIl83dxqwzvDoH8NSifa9mG9oXcZEgdP6rZn_Sox7GZmY4l8vZj0S-4SO-elO0WnSeCE7ARCzFixp-JFp2PLdVsk Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 40ecdf4e71844f7f9e3da7f59659b605 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-TestShelveInstance-1885551334 Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:32:39.264514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40ecdf4e71844f7f9e3da7f59659b605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40ecdf4e71844f7f9e3da7f59659b605"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40ecdf4e71844f7f9e3da7f59659b605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40ecdf4e71844f7f9e3da7f59659b605", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-TestShelveInstance-1885551334 Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 40ecdf4e71844f7f9e3da7f59659b605 Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-TestShelveInstance-1885551334 Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-TestShelveInstance-1885551334-project Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 181df03f4bba4f96afc3c888b3ca9b4d Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-TestShelveInstance-1885551334-project Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. Oct 27 01:32:39.266305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '8f2229ce-290c-40bd-9949-ec88ea4cf9fa'} Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:32:39.267278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. Oct 27 01:32:39.268858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:39.270561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Returning 404 to user: Instance 8f2229ce-290c-40bd-9949-ec88ea4cf9fa could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:32:39.270561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6ff1fe5c-5ba2-4606-8476-1c4745854b28 tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa" status: 404 len: 111 microversion: 2.1 time: 0.036940 Oct 27 01:32:39.270561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 394/790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:39 2022] GET /compute/v2.1/servers/8f2229ce-290c-40bd-9949-ec88ea4cf9fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:39.414092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-40085707-125b-493c-994a-9ea9b8450301 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/action" status: 202 len: 0 microversion: 2.20 time: 0.249150 Oct 27 01:32:39.414830 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 397/791] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 01:32:39 2022] POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:32:39.423758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:39.424628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:39.432716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.433587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.433986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.434752 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:39.435238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:39.435712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:39.453645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-aa31fd72-b0b3-4adc-8c8e-7fdc6d041bfb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] Calling method '.version_select at 0x7f6c12e99940>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:39.475189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-aa31fd72-b0b3-4adc-8c8e-7fdc6d041bfb tempest-TestShelveInstance-1885551334 tempest-TestShelveInstance-1885551334-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-747643760" status: 202 len: 0 microversion: 2.1 time: 0.025665 Oct 27 01:32:39.476543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 398/792] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Oct 27 01:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-747643760 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:32:39.595990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:39.604991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:39.606463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:39.607609 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d9333038-8703-4907-bfe2-c4d4c1d6a698 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.188046 Oct 27 01:32:39.608148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 395/793] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:39 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:40.469532 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f22a1a71-16ce-4e79-883a-1bd2f86a4515"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:40.473161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:40.482363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:40.482949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:40.483475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:40.484189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:40.484642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:40.485108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:40.633701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:40.635018 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:40.642499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:40.643259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:40.643957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:40.645608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:40.646120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:40.646775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:40.815436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-56ad4228-9a32-4635-b207-6077370d8ebd tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "POST /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345335 Oct 27 01:32:40.816608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 399/794] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:32:40 2022] POST /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:40.919662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:40.934412 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:40.936122 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:40.937326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a6b85fa4-41ff-45ba-a443-4e370b014248 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.308416 Oct 27 01:32:40.937872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 396/795] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:40 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:41.966390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:41.968426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:41.975648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:41.976224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:41.976729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:41.977970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:41.978484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:41.978920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:42.224037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:42.233813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:42.236585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:42.238933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9a340b52-ab31-43cc-8bb3-f60ca10b85e8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.278434 Oct 27 01:32:42.249204 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 400/796] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:41 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:43.271573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:43.272224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:43.279000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:43.279473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:43.279906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:43.280593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:43.281041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:43.281486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:43.512052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:43.520269 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:43.521824 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:43.522928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a0e42ce-b365-43bb-9664-3e7370b86597 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.255420 Oct 27 01:32:43.523487 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 397/797] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:43 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:44.550207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:44.551448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:44.559740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:44.560480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:44.561138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:44.562590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:44.563391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:44.563924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:44.790004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:44.804491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:44.806517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:44.807819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d7c1d1bf-b126-4bb9-b077-0fad19899b53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.262457 Oct 27 01:32:44.808488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 401/798] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:44 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:45.838839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:45.839366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:45.853474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:45.853965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:45.854432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:45.855121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:45.856195 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:45.856622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:46.127070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:46.136855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:46.138483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:46.140137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e1f4c5d5-e6b8-4273-9db6-a15d10b27aba tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.305357 Oct 27 01:32:46.140805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 398/799] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:45 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:47.169800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:47.170411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:47.177966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:47.178453 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:47.179398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:47.179575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:47.180319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:47.180751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:47.338216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:47.347395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:47.348858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:47.350078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c0532aa7-0d3d-47b5-82fa-4bc8df4973a0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.184245 Oct 27 01:32:47.350653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 402/800] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:47 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:48.376623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:48.377262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:48.384780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.385316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.385753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.386444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.386911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.387318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.434069 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:48.436468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:48.444544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.445034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.445502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.446196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.446647 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.447073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.480777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7d9d8040-0218-4de7-8f0e-64d51e40bd5f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050614 Oct 27 01:32:48.481387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 403/801] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:32:48 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:32:48.519531 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:48.527515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:48.528942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:48.530139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-732bd47a-a8a3-46bb-a683-3f92deffabf7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.157375 Oct 27 01:32:48.530683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 399/802] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:48 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:48.620676 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:48.621129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:48.627042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.627520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.627997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.628673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.629145 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.629567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.653706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:48.658337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0b75af6e-d306-410a-be62-fb45d82ab51f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f" status: 200 len: 194 microversion: 2.1 time: 0.041698 Oct 27 01:32:48.658914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 404/803] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 01:32:48 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:48.669853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:48.670347 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:48.677257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.677736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.678178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.678854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:48.679306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:48.679728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:48.762119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lazy-loading 'services' on Instance uuid 87e04a9e-c6a7-480b-9da5-abf61d4834ea {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:32:48.835096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-74109a5d-44f3-475a-b4ea-9d1b3381f77f tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f" status: 202 len: 0 microversion: 2.1 time: 0.168950 Oct 27 01:32:48.835671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 400/804] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:32:48 2022] DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/92337809-1aa9-4143-9f36-aae0e272832f => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:32:49.559166 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:49.559769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:49.568169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:49.568643 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:49.569109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:49.569801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:49.570251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:49.570674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:49.697988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:49.706619 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:49.708063 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:49.709287 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5f3128b7-047f-439e-b767-249bc1151169 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.153996 Oct 27 01:32:49.709849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 405/805] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:49 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:50.734928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:50.735613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:50.742924 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:50.743396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:50.743825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:50.744498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:50.744940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:50.745394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:50.883941 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:50.891935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:50.893397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:50.894547 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7f8afc95-953e-4262-aaa6-0a7750d56b68 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.163996 Oct 27 01:32:50.895102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 401/806] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:50 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:51.016506 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:51.017002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:51.023456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.023942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.024382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:51.025102 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.025564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.025994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:51.055532 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6a6a3e0e-2296-4d7b-842e-41b071de669b tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/f22a1a71-16ce-4e79-883a-1bd2f86a4515" status: 200 len: 194 microversion: 2.1 time: 0.042908 Oct 27 01:32:51.056104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 406/807] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Oct 27 01:32:51 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/f22a1a71-16ce-4e79-883a-1bd2f86a4515 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:51.066536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:51.067016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:51.072847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.073351 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.073786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:51.074462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.074903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.075319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:51.153877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lazy-loading 'services' on Instance uuid 87e04a9e-c6a7-480b-9da5-abf61d4834ea {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:32:51.225886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ba3e89b7-6286-43a0-ab5d-3cd605e12701 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/f22a1a71-16ce-4e79-883a-1bd2f86a4515" status: 202 len: 0 microversion: 2.1 time: 0.163036 Oct 27 01:32:51.226534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 402/808] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:32:51 2022] DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments/f22a1a71-16ce-4e79-883a-1bd2f86a4515 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:32:51.919726 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:51.920336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:51.927004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.927491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.927970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:51.928628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:51.929094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:51.929528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.061112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:52.069940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:52.071307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:52.072504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-62f12b61-f3e4-4938-acd9-698bf6c0531e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.156659 Oct 27 01:32:52.073737 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 407/809] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:51 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:52.402060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:52.404407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:52.411388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.411873 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.412311 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.412998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.413477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.413896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.417674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:32:52.446567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ce1469bc-70f8-4a9b-b286-901103be5550 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049418 Oct 27 01:32:52.447119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 403/810] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:32:52 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:32:52.563226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:52.565457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:52.571361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.571846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.572281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.572963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.573435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.573857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.602732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8a0286dc-f29d-4e88-821a-4f8752780552 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043337 Oct 27 01:32:52.603372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 408/811] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:32:52 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:32:52.668521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:52.669051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:52.675799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.676280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.676730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.677444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.677898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.678322 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.703511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:32:52.776175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-898a9701-91aa-4ecf-be12-b292b01260d3 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 204 len: 0 microversion: 2.1 time: 0.111227 Oct 27 01:32:52.777147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 404/812] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:32:52 2022] DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:32:52.786168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:52.786710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:52.792728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.793256 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.793703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.794394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:52.794845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:52.795273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:52.925863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:52.933520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c8befd33-e823-4ea9-af90-266048ba4ad9 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1672 microversion: 2.1 time: 0.152113 Oct 27 01:32:52.934079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 409/813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:52 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:32:53.097647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:53.098336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:53.104221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:53.104702 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:53.105173 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:53.105861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:53.106310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:53.106733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:53.235429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:53.243756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:53.245214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:53.246363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-794c31e7-b579-4a27-bfa3-c27b2328dd21 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.153026 Oct 27 01:32:53.246919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 405/814] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:53 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:53.956282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:53.956890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:53.963366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:53.963859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:53.964418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:53.964982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:53.965463 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:53.965891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:54.097201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:54.104763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-732217aa-f302-47d3-bb25-bd5a3c780610 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1672 microversion: 2.1 time: 0.152422 Oct 27 01:32:54.105353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 410/815] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:53 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:54.272199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:54.272862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:54.279268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:54.279746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:54.280178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:54.280859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:54.281336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:54.281754 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:54.411797 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:54.419790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:54.421276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:54.422431 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3564e76e-718d-4e12-b1b3-6bfe9f893ef6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.154678 Oct 27 01:32:54.422991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 406/816] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:54 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:55.127789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:55.128533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:55.134903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:55.135392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:55.135831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:55.136526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:55.136981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:55.137432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:55.447966 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:55.448603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:55.455176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:55.455663 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:55.456686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:55.457445 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:55.457901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:55.458330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:55.709504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:55.717115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8ede4b51-0d4f-4e3f-9f1e-7aa1c7a9897a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1672 microversion: 2.1 time: 0.593252 Oct 27 01:32:55.717681 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 411/817] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:55 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1672 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:55.750825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:55.759187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:55.760828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:55.762025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2eb863d5-ec0d-4af7-95d1-1a6332885e62 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.318070 Oct 27 01:32:55.762586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 407/818] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:55 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:32:56.180430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e04a9e-c6a7-480b-9da5-abf61d4834ea", "name": "network-vif-deleted", "tag": "71d2db25-bcfb-41e4-867a-87753f3dcc33"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:32:56.191173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.191663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.192098 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.203075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] Creating event network-vif-deleted:71d2db25-bcfb-41e4-867a-87753f3dcc33 for instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea on hv-cinder-81558 Oct 27 01:32:56.208836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-8cf9dbe6-1440-451c-b8f0-6520076ec41e req-ed0416ac-3dde-4265-bca1-545cdda296a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Oct 27 01:32:56.209468 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 412/819] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:32:56.742537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:56.744066 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:56.750617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.751121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.751619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.752447 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.753108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.753774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.788590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.789099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.789544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.790000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lazy-loading 'fault' on Instance uuid 87e04a9e-c6a7-480b-9da5-abf61d4834ea {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:32:56.790458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:56.791277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:56.803622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.804409 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.805095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.806243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:56.806916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:56.807405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:56.844087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca36a277e3643a498b27e3c5d5e14f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1ee6f6a3c3475e8ae993c79ace9166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:56.852387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6faf8d2a-fdb4-480f-9a91-b2e9c5bdefac tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 200 len: 1327 microversion: 2.1 time: 0.113620 Oct 27 01:32:56.853333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 408/820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:56 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:32:56.961603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:56.970101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:56.971591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:56.972776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8504d8b5-e353-48d6-8b65-8b2e3037ce64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1743 microversion: 2.20 time: 0.187090 Oct 27 01:32:56.973528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 413/821] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:56 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:32:57.875733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:57.876334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:57.883473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:57.884003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:57.884444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:57.885151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:57.885599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:57.886017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:57.899956 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea HTTP/1.1 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:32:57.901614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:32:57.902969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '87e04a9e-c6a7-480b-9da5-abf61d4834ea'} Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:32:57.903721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:32:57.904927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:32:57.906817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:32:57.906817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-275adc4a-1cfe-412d-bd21-310bf5481a28 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 404 len: 111 microversion: 2.1 time: 0.031135 Oct 27 01:32:57.906817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 409/822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:32:57 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:32:57.912127 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-11190d68-3c1c-4ab9-8f1b-1153daf93685 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '.version_select at 0x7f6c12f2f1f0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:57.937092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-11190d68-3c1c-4ab9-8f1b-1153daf93685 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755333417" status: 202 len: 0 microversion: 2.1 time: 0.028789 Oct 27 01:32:57.937979 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 414/823] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Oct 27 01:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755333417 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:32:57.999370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:58.000263 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:58.007093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:58.007793 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:58.008230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:58.008919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:58.009390 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:58.009954 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:58.156219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:58.172102 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:58.173817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:58.175725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-97526331-71c2-4942-9783-cd5170df8ad1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1743 microversion: 2.20 time: 0.180132 Oct 27 01:32:58.177120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 410/824] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:57 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:32:59.202121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:32:59.202728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:32:59.209639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:59.210119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:59.210551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:59.211236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:32:59.211687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:32:59.212157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:32:59.342004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:59.350530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:59.351962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:32:59.353138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eaba6363-92e6-40f0-95c1-3077045b2edb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1743 microversion: 2.20 time: 0.155485 Oct 27 01:32:59.353695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 415/825] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:32:59 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:00.067620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "name": "network-vif-plugged", "status": "completed", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:00.073293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:00.079304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.079784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.080219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.091612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] Creating event network-vif-plugged:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:33:00.097188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-87cecc22-3cd6-40ab-b903-2ff915e6c151 req-cde9afc2-96af-430c-a2f5-d729a7a00b1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 Oct 27 01:33:00.097985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 411/826] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:33:00.378274 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:00.378887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:00.385334 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.385825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.386254 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.386944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.387393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.387818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.514393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:00.523114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:00.524529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:00.525793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8ad5c9d4-8b12-401c-a67c-35e0c686997e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1743 microversion: 2.20 time: 0.151606 Oct 27 01:33:00.526352 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 416/827] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:00 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:00.844178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:00.844757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:00.851655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.852132 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.852638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.853379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.853828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.854251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.867682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea HTTP/1.1 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:33:00.869380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.870987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '87e04a9e-c6a7-480b-9da5-abf61d4834ea'} Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:00.871783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.873126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.874364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:00.874364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a9ac2139-e3a2-48cf-9c7c-80ea1390188a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 404 len: 111 microversion: 2.1 time: 0.030967 Oct 27 01:33:00.874364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 412/828] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:00 2022] DELETE /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:00.880137 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:00.880747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 87e04a9e-c6a7-480b-9da5-abf61d4834ea] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:00.886721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.887202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.887640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.888361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:00.888811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:00.889268 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:00.903023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea HTTP/1.1 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:00.904638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.906213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '87e04a9e-c6a7-480b-9da5-abf61d4834ea'} Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:00.907080 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. Oct 27 01:33:00.908555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:00.910002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 87e04a9e-c6a7-480b-9da5-abf61d4834ea could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:00.910002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-16a77401-d3bb-47b9-a221-b3a9a53afc65 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea" status: 404 len: 111 microversion: 2.1 time: 0.030633 Oct 27 01:33:00.910002 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 417/829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:00 2022] GET /compute/v2.1/servers/87e04a9e-c6a7-480b-9da5-abf61d4834ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:01.558161 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:01.558759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:01.565180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:01.565681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:01.566109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:01.566780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:01.567223 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:01.567642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:01.707518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:01.715626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:01.717126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:01.718285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5014a13d-9ff9-4d01-bd44-975476d02cd2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.164017 Oct 27 01:33:01.718833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 413/830] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:01 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:02.053042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:02.053798 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:02.060324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:02.062182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.062882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.063512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.064247 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.064731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.065413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.081612 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 HTTP/1.1 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:02.083687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.085960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '6db3be4b-8f81-4b80-8f8d-801378971478'} Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:02.086827 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.088193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.089530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:02.089530 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-959f1ccc-8697-4bd3-8ec9-eced35bf1b92 tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 404 len: 111 microversion: 2.1 time: 0.037004 Oct 27 01:33:02.093927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:02.094560 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] [instance: 6db3be4b-8f81-4b80-8f8d-801378971478] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:02.096998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 418/831] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:02 2022] DELETE /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:02.101743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.102439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.103494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.104379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.104834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.105323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.119548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] HTTP exception thrown: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Request method failure captured: Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 HTTP/1.1 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd23Kd8ozD2p7IkVBOlIba8Lr-8722ne90QSNGIVYKjevmZffalq-1ONwFtTmcOhZ87EQix6fKgw6y--1s2mUu7e81NNezugalk4msyRP2updOESjJRZsCNSon-czRsz9VW0uWWXH-ddbfltDTmNhEAq4_yvzs4ToVOzdIpdGEjINBQ Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:33:02.121109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b1ee6f6a3c3475e8ae993c79ace9166"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b1ee6f6a3c3475e8ae993c79ace9166", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 1b1ee6f6a3c3475e8ae993c79ace9166 Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1799875887 Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: cca36a277e3643a498b27e3c5d5e14f4 Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeTestJSON-1799875887-project Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.122712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '6db3be4b-8f81-4b80-8f8d-801378971478'} Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:02.123574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. Oct 27 01:33:02.125020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:02.126357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] Returning 404 to user: Instance 6db3be4b-8f81-4b80-8f8d-801378971478 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:02.126357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ffcba459-6b1b-46c3-a0c9-384e6b28b27a tempest-AttachVolumeTestJSON-1799875887 tempest-AttachVolumeTestJSON-1799875887-project] 10.222.0.42 "GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478" status: 404 len: 111 microversion: 2.1 time: 0.032638 Oct 27 01:33:02.126357 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 414/832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:02 2022] GET /compute/v2.1/servers/6db3be4b-8f81-4b80-8f8d-801378971478 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:33:02.748075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:02.748921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:02.757934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.758481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.759350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.760239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:02.760688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:02.763956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:02.930434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:02.939008 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:02.942279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:02.943664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-17474723-ff90-4091-ae2c-1e76d8a2036c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.199671 Oct 27 01:33:02.957085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 419/833] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:02 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:03.974895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:03.977626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:03.995585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:04.001138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:04.001889 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:04.003540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:04.004200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:04.004901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:04.246734 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:04.259245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:04.261007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:04.262432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-758bc4cd-a8e9-4407-9339-7a1359b86424 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.296388 Oct 27 01:33:04.286616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 415/834] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:03 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:05.295516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:05.296122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:05.304944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:05.307546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:05.307546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:05.307546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:05.307546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:05.308108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:05.468524 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:05.478723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:05.480690 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:05.482114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-61c600d9-1997-4b1e-987c-9e2132868d50 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.190602 Oct 27 01:33:05.505190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 420/835] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:05 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:06.518598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:06.519129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:06.535104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:06.535607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:06.536047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:06.536758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:06.537242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:06.537671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:06.778025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:06.790119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:06.792201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:06.793759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-65ac7534-cf9b-4d70-914b-5a96edafb9e9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.283321 Oct 27 01:33:06.817201 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 416/836] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:06 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:06.851312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:06.851849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:06.858892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:06.859423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:06.859864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:06.860576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:06.861028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:06.861544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:06.887316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2a466129-3e03-4fb9-bb5d-101fac0fc692 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/ips" status: 200 len: 149 microversion: 2.1 time: 0.039797 Oct 27 01:33:06.895411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 421/837] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:33:06 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:33:07.831441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:07.832056 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:07.839149 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:07.839916 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:07.840542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:07.841441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:07.842048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:07.842630 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:07.998581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:08.008730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:08.010261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:08.012877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3e7d6229-4239-4200-a03e-37f76e04443d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.194648 Oct 27 01:33:08.013891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 417/838] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:07 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:08.378919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9399dcfc-2074-46c3-bd6e-e19c74e10d57"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:08.381984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:08.389953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:08.390687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:08.391289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:08.392157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:08.392837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:08.393460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:08.774722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cb4768bd-92e8-419d-97e4-8e2ec08e21e6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "POST /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399636 Oct 27 01:33:08.776149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 422/839] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:33:08 2022] POST /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:33:09.040777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:09.042008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:09.054510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:09.055010 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:09.055453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:09.059212 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:09.059699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:09.061409 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:09.274046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:09.282979 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:09.285305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:09.286674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-809fffdc-37dc-416b-bc35-91d00521d3f9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.251547 Oct 27 01:33:09.287674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 418/840] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:09 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:10.316966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:10.318401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:10.326810 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:10.327577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:10.328262 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:10.329337 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:10.329985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:10.331051 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:10.352503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:10.505990 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:10.516220 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:10.518812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:10.520790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c2d201af-cb3a-45c1-a949-8f94e4ef8077 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.208530 Oct 27 01:33:10.521426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 423/841] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:10 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:11.551393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:11.552536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:11.564133 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:11.564938 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:11.565783 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:11.566656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:11.567114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:11.567559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:11.754650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:11.764974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:11.766787 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:11.768339 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a70614b9-b2dc-45bd-ad6d-a550a126fc58 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.221078 Oct 27 01:33:11.768978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 419/842] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:11 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:12.795666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:12.796287 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:12.817192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:12.817939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:12.818554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:12.820065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:12.820887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:12.821495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:13.025266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:13.034687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:13.036149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:13.037567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d109804f-78fa-41d1-a4e9-cb440560bf8a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1738 microversion: 2.20 time: 0.245911 Oct 27 01:33:13.038128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 424/843] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:12 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:14.064144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:14.065468 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:14.078290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:14.078888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:14.079190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:14.080676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:14.081496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:14.081904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:14.107157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:14.307094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:14.315762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:14.317360 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:14.318520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6daceb36-c228-4aa9-ae1a-53c8f0da1efd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1720 microversion: 2.20 time: 0.258737 Oct 27 01:33:14.319081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 420/844] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:14 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:15.344641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:15.345305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:15.352636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:15.353142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:15.353776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:15.354463 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:15.354926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:15.355332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:15.494599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:15.502953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:15.504388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:15.505580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6ed29429-2f9e-44c1-8871-21de8435668c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1720 microversion: 2.20 time: 0.164854 Oct 27 01:33:15.506201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 425/845] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:15 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:16.530547 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:16.531148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:16.537655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:16.538121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:16.538548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:16.539229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:16.539671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:16.540086 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:16.681200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:16.690776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:16.692508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:16.693821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b20cd1a3-c193-4ad1-b3eb-9016a534f3a2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1723 microversion: 2.20 time: 0.167175 Oct 27 01:33:16.694377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 421/846] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:16 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:16.721074 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237ef937-4b77-420a-a8fd-9e6021b59c55"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:16.723613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:16.731073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:16.731745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:16.732202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:16.732911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:16.733398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:16.733914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.059572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e30dc819-bcbb-4883-b99f-8e8c1bdaac31 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343879 Oct 27 01:33:17.060175 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 426/847] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Oct 27 01:33:16 2022] POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 188 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:33:17.190968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:17.191555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:17.197664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.198153 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.198589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.199284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.199733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.200157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.230440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118905) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 01:33:17.299333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-225ec6db-79ad-4243-9404-94761879ebcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/action" status: 202 len: 0 microversion: 2.20 time: 0.111972 Oct 27 01:33:17.300014 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 422/848] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 01:33:17 2022] POST /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:33:17.308156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:17.308766 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:17.315678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.316161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.316617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.317338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.317858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.318212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.463198 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:17.476586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:17.478351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:17.479515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-029e90a0-46ea-477c-b599-0006e2c259a7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1749 microversion: 2.20 time: 0.175370 Oct 27 01:33:17.480359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 427/849] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:17 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:17.587496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:17.588002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:17.593936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.594460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.594869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.596200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.596659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.597103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.679737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'services' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:17.756886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0f38dcd2-ded5-4de1-97da-baf4b3fdb05b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments/9399dcfc-2074-46c3-bd6e-e19c74e10d57" status: 202 len: 0 microversion: 2.1 time: 0.173428 Oct 27 01:33:17.758280 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 423/850] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:33:17 2022] DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments/9399dcfc-2074-46c3-bd6e-e19c74e10d57 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:33:17.767826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:17.770104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:17.782037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.782527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.783793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.784563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:17.785226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:17.785652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:17.821688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8cabdfdd-2130-4342-9101-4966cda00215 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059093 Oct 27 01:33:17.822491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 428/851] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:33:17 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:33:18.169722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "name": "network-vif-unplugged", "status": "completed", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:18.182605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.183767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.184420 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.196460 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.compute.server_external_events [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] Unable to find a host for instance b414d9ca-9bc2-4101-953a-4f866cf4326f. Dropping event network-vif-unplugged {{(pid=118905) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 01:33:18.197363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-b598422b-1121-46a4-a4d6-65fbe6192707 req-3f4b8717-4f08-4ea9-af76-4677f3b4fc8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032421 Oct 27 01:33:18.197952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 424/852] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 27 01:33:18.508116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:18.508836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:18.514801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.515265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.515699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.516392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.516837 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.517353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.666999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:18.677822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:18.679831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:18.681013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bcf2d961-62b8-4867-9ef6-80959d68b8de tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1751 microversion: 2.20 time: 0.176813 Oct 27 01:33:18.681628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 429/853] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:18 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:18.834880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:18.837160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:18.843396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.843947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.844387 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.845092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.846035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.846491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.876394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e27650b1-e75c-43bd-9fa3-46fc2bdec8d6 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045477 Oct 27 01:33:18.877091 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 425/854] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:33:18 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:33:18.944021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:18.944640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:18.950496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.951056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.951567 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.952318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:18.952829 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:18.953292 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:18.980915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:33:19.061391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-35da8e77-535e-4ec9-8106-9c7a7faec2c8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 204 len: 0 microversion: 2.1 time: 0.121550 Oct 27 01:33:19.062362 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 430/855] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:18 2022] DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:33:19.073383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:19.074156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:19.080701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:19.080869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:19.081359 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:19.082060 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:19.082655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:19.083114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:19.232661 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:19.241966 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5baddece-d25c-4b66-87f0-ffd02597323d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1681 microversion: 2.1 time: 0.173943 Oct 27 01:33:19.242526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 426/856] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:19 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:19.708463 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:19.709284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:19.715167 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:19.715669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:19.716106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:19.716799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:19.717269 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:19.717689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:19.853413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:19.862957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:19.864395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:19.865634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1cda703a-dfcd-42b2-8330-40cbe1e2780e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1751 microversion: 2.20 time: 0.161589 Oct 27 01:33:19.866201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 431/857] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:19 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:20.266775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:20.267597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:20.274821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:20.275527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:20.276006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:20.276703 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:20.277186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:20.277746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:20.421985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:20.444260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b4563bc-c15b-49f8-a6fa-e108dedd263c tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1681 microversion: 2.1 time: 0.182391 Oct 27 01:33:20.445380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 427/858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:20 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:20.893248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:20.893987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:20.900485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:20.900969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:20.901437 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:20.902139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:20.902592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:20.903018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:21.155307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:21.164668 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:21.166208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:21.167353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-87d80d58-e72f-4561-9035-b9b6a4c8c8ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.279463 Oct 27 01:33:21.167905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 432/859] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:20 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:21.468685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:21.470237 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:21.479072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:21.479848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:21.480466 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:21.481758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:21.482261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:21.483082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:21.726501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:21.736688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-982ec4ba-aa62-4fc2-83a7-155bb9ca7b95 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1681 microversion: 2.1 time: 0.271775 Oct 27 01:33:21.737638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 428/860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:21 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:21.960817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e95155-e929-4282-ac51-d3b872f832fa", "name": "network-vif-deleted", "tag": "311d6690-3b36-4df2-b7a5-5b40b0331297"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:21.972956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:21.973487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:21.973939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:21.995460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] Creating event network-vif-deleted:311d6690-3b36-4df2-b7a5-5b40b0331297 for instance 62e95155-e929-4282-ac51-d3b872f832fa on hv-cinder-81558 Oct 27 01:33:22.001378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-f536609d-5f30-4d41-ba64-a7cfd393812f req-f674cfca-98de-499b-a34a-467247144818 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044196 Oct 27 01:33:22.006818 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 433/861] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:33:22.195658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:22.196654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:22.205243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:22.206005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:22.206770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:22.207717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:22.208171 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:22.208597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:22.385427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:22.397743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:22.399215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:22.400394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2f825dd9-f702-4593-be69-76aea1197365 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.209073 Oct 27 01:33:22.401277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 429/862] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:22 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:22.762392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:22.763606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:22.774863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:22.776769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:22.777475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:22.778402 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:22.779088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:22.779890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:22.819173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:22.823309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:22.823856 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:22.824409 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:22.888927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:22.897925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f9ba5a01-78fe-47fd-9d42-e0e0ceff5c5b tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.140558 Oct 27 01:33:22.898857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 434/863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:22 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:23.428353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:23.429004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:23.436411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:23.436977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:23.437585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:23.438438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:23.438759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:23.439451 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:23.600907 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:23.611456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:23.613517 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:23.614933 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b21f137b-ac20-49de-9261-e2dad4406252 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.191659 Oct 27 01:33:23.615492 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 430/864] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:23 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:23.927113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:23.928172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:23.934992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:23.935477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:23.935911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:23.936613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:23.937075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:23.937516 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:23.975577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:23.976054 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:23.976489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:23.976932 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:24.023815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:24.027721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:24.033710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0c1e83af-374e-4d06-9cb3-528e35047295 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.110098 Oct 27 01:33:24.047075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:23 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:33:24.643545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:24.644285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:24.651106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:24.651648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:24.652114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:24.652808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:24.653300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:24.653726 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:24.805697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:24.814985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:24.816555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:24.817809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-72ff0f44-818f-44aa-8648-9aca992c2f0c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.180134 Oct 27 01:33:24.818399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 431/866] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:24 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:25.061916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:25.063713 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:25.081359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:25.082319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:25.082945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:25.084312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:25.084934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:25.085655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:25.136471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:25.137040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:25.137861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:25.138400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:25.190060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:25.199065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-95f6d84b-17cb-4fab-b8d7-fe361ea5f8ac tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.143758 Oct 27 01:33:25.202018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 436/867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:25 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:33:25.844860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:25.846866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:25.854467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:25.855057 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:25.855602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:25.856381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:25.856992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:25.857581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:26.004303 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:26.013932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:26.015612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:26.017983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d1b22251-5f1b-417e-8a4b-791151586808 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.177915 Oct 27 01:33:26.019109 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 432/868] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:25 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:26.225628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:26.226209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:26.232469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:26.232948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:26.233422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:26.234112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:26.234558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:26.234982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:26.274432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:26.275146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:26.275638 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:26.276157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:26.323099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:26.331487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-58524a6d-0ede-4719-9f05-637719714fe9 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.109854 Oct 27 01:33:26.332040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 437/869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:26 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:27.045637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:27.046216 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:27.053174 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:27.053652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:27.054081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:27.054767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:27.055212 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:27.055632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:27.223741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:27.232409 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:27.233887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:27.235041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7f4cf391-5dbe-43de-9866-b4da72c02160 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.193375 Oct 27 01:33:27.235716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 433/870] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:27 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:33:27.354840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:27.356356 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:27.364203 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:27.365084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:27.368475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:27.369668 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:27.370350 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:27.371017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:27.404697 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:27.405297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:27.405745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:27.406230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:27.451107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:27.459622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b0708cbf-16f1-47bb-8b72-6cb53b4c8325 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.108643 Oct 27 01:33:27.460257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 438/871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:27 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:28.261587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:28.262181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:28.272085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:28.272628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:28.273043 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:28.273741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:28.274187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:28.274606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:28.446421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:28.457612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:28.459291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:28.460497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-64ddc35f-972e-4ccd-a98e-af508276204b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.203086 Oct 27 01:33:28.461093 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 434/872] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:28 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:28.484417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:28.485106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:28.492674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:28.493300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:28.493747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:28.494460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:28.494915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:28.495342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:28.531290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:28.531641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:28.532800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:28.533421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:28.587097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:28.596042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-19cb5f20-8426-4f5d-a5b9-6318135236ef tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.115518 Oct 27 01:33:28.597232 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:28 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:29.491951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:29.493491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:29.500137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:29.500970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:29.503050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:29.504005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:29.504666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:29.505355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:29.631252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:29.632071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:29.639460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:29.640054 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:29.640556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:29.641302 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:29.641852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:29.642537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:29.700234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:29.703900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:29.705214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:29.706694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:29.887100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:29.896143 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-26e31b0c-fe57-44ff-88fb-1d5296a130d5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.269747 Oct 27 01:33:29.913750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 440/874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:29 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:33:29.959428 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:29.972619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:29.975245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:29.977849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b78da377-ed98-46e8-a60f-43385b0513f0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.489717 Oct 27 01:33:29.993606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 435/875] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:29 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:30.919776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:30.920385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:30.927728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:30.928203 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:30.928637 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:30.929344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:30.929790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:30.930210 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:30.965222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:30.965711 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:30.966154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:30.966891 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:31.003822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:31.004520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:31.006897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:31.013095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:31.013568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:31.013568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:31.013568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:31.015861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:31.015861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:31.015861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:31.020623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0ce31fb0-c353-4f69-a0a6-25a4db099e30 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.104680 Oct 27 01:33:31.021652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 441/876] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:30 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:33:31.042363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:31.168120 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:31.177140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:31.178586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:31.179768 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c416f3bd-9db8-4885-a1ac-069533a11b97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.179922 Oct 27 01:33:31.180336 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 436/877] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:30 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:32.046383 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:32.047033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:32.053743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:32.054228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:32.054671 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:32.055398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:32.055854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:32.056282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:32.085135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:32.090299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:32.090779 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:32.091218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:32.091669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:32.134128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:32.142050 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-521a321d-100a-4da5-8fbc-2c7b7e246225 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.099378 Oct 27 01:33:32.142750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 442/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:32 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:32.204870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:32.205507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:32.212009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:32.212510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:32.212939 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:32.213659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:32.214154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:32.214594 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:32.347373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:32.355721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:32.357178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:32.358319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b1ef12df-5e24-4d7d-81ed-3e963b284039 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.157399 Oct 27 01:33:32.358870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 437/879] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:32 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:33.164120 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:33.164729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:33.171071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:33.171558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:33.171993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:33.172685 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:33.173991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:33.174418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:33.205747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:33.206226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:33.206663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:33.207105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:33.246563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:33.254533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1a4d96c9-90e2-4f6f-9835-2268eeafc167 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.094293 Oct 27 01:33:33.255088 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 443/880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:33 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:33.383563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:33.384177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:33.390501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:33.390987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:33.391410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:33.392669 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:33.393154 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:33.393580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:33.670070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:33.678730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:33.680155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:33.681325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4d6bfa41-ab0d-4be7-9434-939888220978 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.301589 Oct 27 01:33:33.681877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 438/881] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:33 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:34.276597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:34.277251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:34.284371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:34.284884 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:34.285340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:34.286029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:34.286481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:34.286906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:34.316993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:34.317497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:34.317933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:34.318381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:34.360843 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:34.368435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-29f6a607-e827-440d-93d2-8e9b8a51e127 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.095705 Oct 27 01:33:34.368994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 444/882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:34 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:34.707361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:34.707969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:34.714714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:34.715198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:34.715637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:34.716328 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:34.716785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:34.717252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:34.844323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:34.853182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:34.854644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:34.855790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3928813d-609c-4ae9-b74d-50f113916011 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.152694 Oct 27 01:33:34.856340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 439/883] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:34 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:35.392580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:35.393240 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:35.399574 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:35.400057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:35.400498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:35.401231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:35.401687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:35.402118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:35.433321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:35.433794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:35.434232 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:35.434673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:35.475582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:35.483376 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-09d83e01-f1a1-4862-967c-43ccfc6af559 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.094860 Oct 27 01:33:35.484720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 445/884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:35 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:35.882490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:35.883101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:35.889593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:35.890082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:35.890528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:35.891221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:35.892474 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:35.892913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:36.022277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:36.030798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:36.032728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:36.034009 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-248ff507-1ceb-484a-b9cf-f90ad91464ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.155436 Oct 27 01:33:36.034557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 440/885] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:35 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:36.507317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:36.507971 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:36.514324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:36.514797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:36.515229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:36.515937 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:36.516381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:36.517797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:36.548964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:36.549460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:36.549894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:36.550332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:36.590714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:36.598238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b767c621-9874-40f7-ac6e-e83c5f991d9d tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.094720 Oct 27 01:33:36.598793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 446/886] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:36 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:37.059833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:37.060444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:37.067212 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:37.067697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:37.068136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:37.068829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:37.069317 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:37.069767 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:37.196940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:37.205855 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:37.207366 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:37.208539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2d9aa967-4941-4e9b-bd71-05914b73c575 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.152645 Oct 27 01:33:37.209103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 441/887] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:37 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:37.621246 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:37.621764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:37.628162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:37.628642 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:37.629085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:37.629783 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:37.630230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:37.630654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:37.660495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:37.660964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:37.661423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:37.661863 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lazy-loading 'fault' on Instance uuid 62e95155-e929-4282-ac51-d3b872f832fa {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:33:37.705645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99bcd22ff73b4526a54cf0e76f509436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db70dacc270d431182451b57b277484f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:37.713300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4aa6b456-d817-433a-8fc3-3d77bd3ae037 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 200 len: 1332 microversion: 2.1 time: 0.096069 Oct 27 01:33:37.713858 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 447/888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:37 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:33:38.234469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:38.235105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:38.241733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:38.242134 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:38.242566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:38.243253 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:38.243704 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:38.244126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:38.373961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:38.383000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:38.384443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:38.385633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c82de90d-3d5c-48c1-9233-b129b3d00671 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.155252 Oct 27 01:33:38.386182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 442/889] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:38 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:38.736520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:38.737156 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:38.743510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:38.743991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:38.744423 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:38.745134 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:38.745600 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:38.746012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:38.759123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa HTTP/1.1 Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:38.760723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:38.762398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '62e95155-e929-4282-ac51-d3b872f832fa'} Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:38.763325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:38.764590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:38.765800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:38.765800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-afa096f2-2807-42c0-9359-d6ba11f171d4 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 404 len: 111 microversion: 2.1 time: 0.029647 Oct 27 01:33:38.765800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 448/890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:38 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:38.771550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5c6cda83-d2e6-4079-a82d-fdcb599f0565 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '.version_select at 0x7f6c140099d0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:38.790575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5c6cda83-d2e6-4079-a82d-fdcb599f0565 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302923156" status: 202 len: 0 microversion: 2.1 time: 0.022724 Oct 27 01:33:38.791121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 443/891] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Oct 27 01:33:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302923156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:33:39.413510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:39.414117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:39.420216 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:39.420757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:39.421227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:39.421915 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:39.422363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:39.423786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:39.427805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=100 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:33:39.569469 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:39.578092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:39.580161 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:39.581333 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9dd0f00f-4a37-4b5c-b64a-ba1fd6aa3798 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.172074 Oct 27 01:33:39.581878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 449/892] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:39 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:40.553835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:40.554432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:40.561016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.561530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.561960 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.562639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.563084 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.563501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.579045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa HTTP/1.1 Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:33:40.581479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.582974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '62e95155-e929-4282-ac51-d3b872f832fa'} Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:40.583711 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.585332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.586906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:40.586906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-55c12170-f6e0-4a1b-bc88-26a0d2dab13f tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 404 len: 111 microversion: 2.1 time: 0.034004 Oct 27 01:33:40.586906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 444/893] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:40 2022] DELETE /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:40.591374 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:40.591988 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 62e95155-e929-4282-ac51-d3b872f832fa] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:40.598371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.598849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.599283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.599966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.600435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.600859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.606842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:40.607485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:40.613846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.614326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.614759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.615081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.615448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:40.615903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:40.616333 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa HTTP/1.1 Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:40.616603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.618065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '62e95155-e929-4282-ac51-d3b872f832fa'} Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:40.618780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. Oct 27 01:33:40.619958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:40.621094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 62e95155-e929-4282-ac51-d3b872f832fa could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:40.621094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-46889e56-1fdd-4f0c-8ad0-5ff8d4cbfdd2 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa" status: 404 len: 111 microversion: 2.1 time: 0.030444 Oct 27 01:33:40.621094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 450/894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:40 2022] GET /compute/v2.1/servers/62e95155-e929-4282-ac51-d3b872f832fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:33:40.749345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:40.758607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:40.760130 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:40.761316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b5d8e19c-513a-4ed8-b53e-f5e9e6275dcd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.158305 Oct 27 01:33:40.761871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 445/895] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:40 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:33:41.758892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:41.759377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:41.765738 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.766219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.766657 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.767365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.767817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.768981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.782800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 HTTP/1.1 Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:41.784414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.786188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '98d15b42-2b49-49a1-bfcb-fb3066eec6f9'} Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:41.787296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.788873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.791315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:41.791315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fa197007-13e7-42f6-b3fa-d94bdbf55ca8 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 404 len: 111 microversion: 2.1 time: 0.030775 Oct 27 01:33:41.791315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 451/896] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:41 2022] DELETE /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:41.792124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:41.792909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:41.794154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:41.794766 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 98d15b42-2b49-49a1-bfcb-fb3066eec6f9] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:41.801414 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.802167 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.802855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.803774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.804451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.805053 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.806968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.807600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.808126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.809103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.815536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.816061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.822959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 HTTP/1.1 Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:41.824497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.826257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '98d15b42-2b49-49a1-bfcb-fb3066eec6f9'} Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:41.827083 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. Oct 27 01:33:41.828543 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.830230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 98d15b42-2b49-49a1-bfcb-fb3066eec6f9 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:41.830230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-139d0dd3-e581-40be-a31f-7109104dc790 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9" status: 404 len: 111 microversion: 2.1 time: 0.035540 Oct 27 01:33:41.830230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 452/897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:41 2022] GET /compute/v2.1/servers/98d15b42-2b49-49a1-bfcb-fb3066eec6f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:41.835048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:41.835547 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:41.841606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.842286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.842718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.843736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.844392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.844623 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.858928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f HTTP/1.1 Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:41.860757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.862920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'd7f4c33b-ade5-4dbc-821f-a0d9273b643f'} Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:41.863852 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.865316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.866800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:41.867113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a798b3cf-d595-4049-b812-7de93a3befd5 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 404 len: 111 microversion: 2.1 time: 0.036237 Oct 27 01:33:41.870529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 453/898] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:41 2022] DELETE /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:41.878825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:41.879438 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: d7f4c33b-ade5-4dbc-821f-a0d9273b643f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:41.885582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.886070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.886528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.887264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:41.887725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:41.888154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:41.927082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f HTTP/1.1 Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:41.928894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.930673 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'd7f4c33b-ade5-4dbc-821f-a0d9273b643f'} Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:41.931842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. Oct 27 01:33:41.933490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:41.935969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance d7f4c33b-ade5-4dbc-821f-a0d9273b643f could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:41.937138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-06406a16-7697-43c3-af9a-0d268eacef76 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f" status: 404 len: 111 microversion: 2.1 time: 0.062963 Oct 27 01:33:41.938238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 454/899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:41 2022] GET /compute/v2.1/servers/d7f4c33b-ade5-4dbc-821f-a0d9273b643f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:41.987518 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:42.005372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:42.006811 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:42.008113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-cbe80988-d2d4-48ac-9b73-e0d697eadd6f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.225679 Oct 27 01:33:42.008977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 446/900] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:41 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:33:43.034014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:43.034620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:43.041139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:43.041624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:43.042062 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:43.042756 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:43.043208 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:43.043632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:43.177989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:43.186367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:43.187784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:43.188913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e6eb7431-b50b-4172-872b-39332c9badb7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.158758 Oct 27 01:33:43.189493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 455/901] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:43 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:44.214433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:44.215049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:44.221621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:44.222107 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:44.222586 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:44.223285 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:44.223747 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:44.224176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:44.350732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:44.359271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:44.360723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:44.362513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ef5b8eeb-2d28-4365-9da8-c00e9f30f46f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.151450 Oct 27 01:33:44.363214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 447/902] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:44 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:45.388089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:45.388620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:45.395157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:45.395633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:45.396065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:45.396742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:45.397214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:45.397633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:45.528874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:45.537896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:45.539324 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:45.540477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cd438b37-e10b-415c-ac90-b2ef3ca2126d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.156517 Oct 27 01:33:45.541028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 456/903] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:45 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:46.567559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:46.568166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:46.574587 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:46.575071 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:46.575509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:46.576197 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:46.576676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:46.577129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:46.705577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:46.714095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:46.715536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:46.716685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f8e06e2e-f6c8-4ac0-81d6-7455c6c01877 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.153674 Oct 27 01:33:46.717268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 448/904] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:46 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:47.332301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:47.332797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:47.339149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.339634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.340071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.340763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.341310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.341740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.355579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 HTTP/1.1 Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:33:47.357043 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.358487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '7e0043e0-d539-46b1-bdd1-8adc22ef0d95'} Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:47.359230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.360507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.362716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:47.362716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d8a31936-082a-45a3-9b86-81684090de87 tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 404 len: 111 microversion: 2.1 time: 0.030176 Oct 27 01:33:47.362716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 457/905] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:33:47 2022] DELETE /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:47.367724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:47.368362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] [instance: 7e0043e0-d539-46b1-bdd1-8adc22ef0d95] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:47.374238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.374710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.375139 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.375814 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.376259 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.376676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.389574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] HTTP exception thrown: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Request method failure captured: Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 HTTP/1.1 Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd215nwD3RyEycJJd328n-49TXYlV2VRT1SI5QpW382v42V9ajfKwcLGVCID4vDQDqRxfiS3w1WylO7F1m6-i2V24H3DMyJoBNplT1_aP_es3RQhXRGtyjxkP_nIYLOygvvXHMX9iRMvHLJbMTg91SodNF-p5S9X6SJc1k0IrZNcAVY Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:33:47.391075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/db70dacc270d431182451b57b277484f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/db70dacc270d431182451b57b277484f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_db70dacc270d431182451b57b277484f", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: db70dacc270d431182451b57b277484f Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2057385876 Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 99bcd22ff73b4526a54cf0e76f509436 Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeNegativeTest-2057385876-project Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.392683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '7e0043e0-d539-46b1-bdd1-8adc22ef0d95'} Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:33:47.394092 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. Oct 27 01:33:47.395590 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:33:47.397020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] Returning 404 to user: Instance 7e0043e0-d539-46b1-bdd1-8adc22ef0d95 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:33:47.397020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-59736cc0-ceb9-4c9f-a67d-4fdd199c98ab tempest-AttachVolumeNegativeTest-2057385876 tempest-AttachVolumeNegativeTest-2057385876-project] 10.222.0.42 "GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95" status: 404 len: 111 microversion: 2.1 time: 0.028537 Oct 27 01:33:47.397020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 449/906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:33:47 2022] GET /compute/v2.1/servers/7e0043e0-d539-46b1-bdd1-8adc22ef0d95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:33:47.742768 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:47.743378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:47.749263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.749743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.750183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.750868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:47.751326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:47.751767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:47.973160 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:47.981751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:47.983289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:47.984449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7187772a-da44-413e-acad-c82304b9efd8 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.245619 Oct 27 01:33:47.985023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 458/907] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:47 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:49.011659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:49.012875 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:49.019722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:49.020465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:49.021121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:49.021993 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:49.022821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:49.023540 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:49.255830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:49.271187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:49.272619 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:49.273829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6cf99582-47cd-4976-bebf-3fe5a4d2286f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.267119 Oct 27 01:33:49.274697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 450/908] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:49 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:50.301431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:50.306210 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:50.316382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:50.316875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:50.317338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:50.318038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:50.318486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:50.318906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:50.636508 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:50.656907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:50.659246 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:50.660527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-19e9b532-5ab0-4211-ba5c-05083021fede tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.364503 Oct 27 01:33:50.661207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 459/909] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:50 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:51.686849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:51.687567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:51.694683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:51.695178 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:51.695622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:51.696318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:51.696773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:51.697228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:51.850147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:51.859772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:51.861236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:51.863499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5ec9d4c1-d9ce-4e98-a6a7-e548e061cc2f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.180845 Oct 27 01:33:51.864036 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 451/910] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:51 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:33:52.322013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "name": "network-vif-plugged", "status": "completed", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:33:52.332695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:52.333190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:52.333961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:52.347881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] Creating event network-vif-plugged:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:33:52.352836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-052798ea-c1f3-427b-abcd-4a7688127829 req-a978c00c-5759-48d5-a761-6bc8056eb5d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Oct 27 01:33:52.353824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 460/911] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:33:52.889946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:52.891214 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:52.899559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:52.900225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:52.900682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:52.901840 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:52.902499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:52.902982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:53.053052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:53.063679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:53.065188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:53.066485 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6b3c0586-0f45-45f2-8339-b2921a4c8b84 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.180339 Oct 27 01:33:53.067346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 452/912] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:52 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:54.093531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:54.095315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:54.103707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:54.104196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:54.104626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:54.105351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:54.106665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:54.107257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:54.249126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:54.257767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:54.259186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:54.260328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-abd7351d-bccd-4c96-9639-1f7b1cadb8c6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.172246 Oct 27 01:33:54.260882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 461/913] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:54 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:55.286099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:55.286712 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:55.293176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:55.293667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:55.294130 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:55.294812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:55.295263 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:55.295687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:55.426603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:55.435270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:55.436710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:55.437893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-74ca8030-a3e9-41a0-b381-5a81244c11aa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.155699 Oct 27 01:33:55.438433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 453/914] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:55 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:33:56.463745 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:56.464273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:56.470942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:56.471598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:56.472046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:56.472753 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:56.473254 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:56.473688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:56.601357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:56.609890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:56.611336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:56.613094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9afce72a-17ec-4ce0-8547-d17ab50627e0 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.153314 Oct 27 01:33:56.613648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 462/915] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:56 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:57.638414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:57.639012 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:57.646484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:57.646961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:57.647393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:57.648072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:57.648522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:57.648940 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:57.780430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:57.788984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:57.790463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:57.791617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-614222ab-cd89-4702-a96f-91679f81b832 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1807 microversion: 2.20 time: 0.157064 Oct 27 01:33:57.792167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 454/916] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:57 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:33:58.817895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:33:58.818417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:33:58.825615 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:58.826186 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:58.826677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:58.827401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:33:58.827854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:33:58.828280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:33:58.955494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:58.965297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:58.966740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:33:58.967975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d29ec330-b9be-4942-a129-1e41c8da9a39 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1794 microversion: 2.20 time: 0.155193 Oct 27 01:33:58.968812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 463/917] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:33:58 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:34:08.299373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1481066028", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "networks": [{"uuid": "9bca76cc-1d50-4e49-963d-abcefbafe61e"}]}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:08.308653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:08.309346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=98 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:08.509684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] validate_networks() for [('9bca76cc-1d50-4e49-963d-abcefbafe61e', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:34:08.864443 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:34:08.864835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:34:08.865690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:34:08.866208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:34:08.867000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:34:08.879175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:08.880176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:08.880605 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:08.881355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:08.881807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:08.882228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:08.899131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Getting quotas for project 176e5a3c112e4967a83375c948008ab5. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:34:08.903037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Getting quotas for user 2321134e938247b09711047a12b86382 and project 176e5a3c112e4967a83375c948008ab5. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:34:08.913835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:34:08.916133 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:34:08.962076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4dc0ef14-3fff-4e20-a552-11348c4010cf tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667037 Oct 27 01:34:08.962710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 455/918] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:34:08.973709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-96e6bbcf-5493-4eae-9b07-9d60ab76692b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:08.974330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-96e6bbcf-5493-4eae-9b07-9d60ab76692b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:08.976985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=53 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:08.977762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=60 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:09.141568 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-96e6bbcf-5493-4eae-9b07-9d60ab76692b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:09.149287 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-96e6bbcf-5493-4eae-9b07-9d60ab76692b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1219 microversion: 2.1 time: 0.179420 Oct 27 01:34:09.161876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 464/919] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:08 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:10.174153 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:10.174803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:10.183835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:10.184645 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:10.185499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:10.186473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:10.187244 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:10.187971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:10.266260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:10.275908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d76c941b-60e8-4bbe-9b9b-126f209c5ed4 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1289 microversion: 2.1 time: 0.107070 Oct 27 01:34:10.276427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 456/920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:10 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:11.298844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:11.299385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:11.307076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:11.307558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:11.307996 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:11.308690 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:11.309159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:11.309742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:11.513507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:11.524064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5843a4e4-ca46-4fd7-a8c6-a685eaadeffc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.229175 Oct 27 01:34:11.524940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 465/921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:11 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:11.546250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a88755-9cac-418c-b267-32d0b4cf6bb3", "tag": "916c39b7-b2b2-4248-bcce-53ebf91190cb"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:11.562438 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:11.563034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:11.563647 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:11.576448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] Creating event network-changed:916c39b7-b2b2-4248-bcce-53ebf91190cb for instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 on hv-cinder-81558 Oct 27 01:34:11.582171 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-0bcc132d-8509-4894-92ca-aa3f3aa5ef15 req-843ec9b6-1fee-43ba-92c0-2a7eaa5a3584 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042529 Oct 27 01:34:11.583206 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 457/922] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:34:12.547849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:12.548987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:12.556079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:12.556563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:12.557011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:12.557695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:12.558147 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:12.558563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:12.700369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:12.709454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5322ffc4-f248-4db3-8cec-2f4f3f54448b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.165802 Oct 27 01:34:12.710022 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 466/923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:12 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:13.732222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:13.732929 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:13.739599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:13.740080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:13.740512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:13.741232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:13.741685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:13.742265 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:13.885859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:13.893498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-226cf540-a2ba-43d3-af14-4baa592367cc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.165394 Oct 27 01:34:13.894054 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 458/924] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:13 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:14.917767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:14.918384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:14.924739 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:14.925271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:14.925720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:14.927038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:14.927486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:14.927914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:15.056149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:15.063704 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-35f00e13-6f5b-4914-80e0-4e35e40cb4df tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.149870 Oct 27 01:34:15.064258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 467/925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:14 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:16.086029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:16.086570 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:16.092857 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:16.093371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:16.093810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:16.094498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:16.094952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:16.095380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:16.221686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:16.229995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-06f08026-806d-48ea-a51c-69fc30a8c3c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.148052 Oct 27 01:34:16.230554 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 459/926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:16 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:17.253243 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:17.253872 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:17.261335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:17.261822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:17.262251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:17.262959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:17.263389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:17.263813 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:17.401936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:17.409929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8a7fa1ec-247c-4ebb-91b9-0d5718a105dc tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.160565 Oct 27 01:34:17.411131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 468/927] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:17 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:18.435034 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:18.435749 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:18.442250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:18.442686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:18.443126 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:18.443827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:18.444277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:18.444705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:18.475772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a88755-9cac-418c-b267-32d0b4cf6bb3", "name": "network-vif-plugged", "status": "completed", "tag": "916c39b7-b2b2-4248-bcce-53ebf91190cb"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:18.485986 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:18.486718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:18.487281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:18.516963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] Creating event network-vif-plugged:916c39b7-b2b2-4248-bcce-53ebf91190cb for instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 on hv-cinder-81558 Oct 27 01:34:18.522406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-9415c9e8-7002-4e64-9267-941b0c031f0b req-4c3154a2-258d-4d45-89b9-e4cef0498d01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050692 Oct 27 01:34:18.523234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 469/928] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:34:18.592694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:18.601725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4850c7d2-ef0a-4d4b-9fb7-883d8136cc10 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.170456 Oct 27 01:34:18.602291 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 460/929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:18 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:19.624378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:19.625175 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:19.627183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:19.634096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:19.634582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:19.635025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:19.635756 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:19.636214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:19.636641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:19.827385 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:19.836273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-903e5842-dd65-4271-aa8c-c29753d9d286 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1319 microversion: 2.1 time: 0.216104 Oct 27 01:34:19.837040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 470/930] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:19 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:20.859759 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:20.860378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:20.862989 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:20.863951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:20.870718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:20.871203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:20.871636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:20.872458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:20.872974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:20.873589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:21.010103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:21.017865 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-550a8c39-b03d-4d40-a3fe-3225ce9a74c8 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1507 microversion: 2.1 time: 0.162009 Oct 27 01:34:21.018431 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 461/931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:20 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:42.847485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74ef6268-7047-441e-bd3f-d12b5683cca6", "device": "/dev/sdb"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:42.852238 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:42.855320 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:34:42.855502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3/os-volume_attachments (ip 10.222.0.42) !!! Oct 27 01:34:42.856611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=16 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:42.857408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=32 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:42.864997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:42.865795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:42.866412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:42.867202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:42.867661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:42.868084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:43.201587 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8031c947-970c-4540-847c-f05ecca83140 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "POST /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358509 Oct 27 01:34:43.202213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 471/932] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:34:42 2022] POST /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:34:46.730078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-43cb023f-6eea-4937-b9eb-acb0ff8d7cba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'create', calling method: .version_select at 0x7f6c12ff5550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-302479538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWtZ3vEtVY/lIeyI660+WV2zN4JEETfqRnrW2ULnwhCDWzgpRM0WTHG1GhoJoVKt29RbQGBXo8XZtRwXhjQodlCwmSjts3sEfvpcRbvBRWjQrvZzroYx7tdI7I5Eb26yg=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:46.736411 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:46.737203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=34 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:46.750562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-43cb023f-6eea-4937-b9eb-acb0ff8d7cba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Getting quotas for project 9e496297038149beb8bfe69c53234988. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:34:46.754300 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-43cb023f-6eea-4937-b9eb-acb0ff8d7cba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Getting quotas for user e1ff3076fbb342caaf7d617c079a9080 and project 9e496297038149beb8bfe69c53234988. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:34:46.775901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-43cb023f-6eea-4937-b9eb-acb0ff8d7cba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050291 Oct 27 01:34:46.776497 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 462/933] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:34:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:34:46.828202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-585597307", "imageRef": "a91469bf-795e-41bd-b60a-8942250320d8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-302479538", "networks": [{"uuid": "170ef906-51b9-4ed2-98f7-40cadf9de9a4"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:34:46.879575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] validate_networks() for [('170ef906-51b9-4ed2-98f7-40cadf9de9a4', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:34:47.255342 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:34:47.255764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:34:47.256261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:34:47.256665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:34:47.257871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:34:47.266563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:47.267039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:47.267472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:47.268195 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:47.268640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:47.269084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:47.285747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Getting quotas for project 9e496297038149beb8bfe69c53234988. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:34:47.290121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Getting quotas for user e1ff3076fbb342caaf7d617c079a9080 and project 9e496297038149beb8bfe69c53234988. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:34:47.300969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:34:47.303303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a91469bf-795e-41bd-b60a-8942250320d8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:34:47.349809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b0276b3c-6cd5-4ce0-b01f-d491aa63c5e8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526388 Oct 27 01:34:47.350456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 472/934] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:34:47.361459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-15ab04ab-8531-4e45-9d05-9558abdc7a60 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:47.362047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-15ab04ab-8531-4e45-9d05-9558abdc7a60 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:47.418459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-15ab04ab-8531-4e45-9d05-9558abdc7a60 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:47.426486 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-15ab04ab-8531-4e45-9d05-9558abdc7a60 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1257 microversion: 2.1 time: 0.069014 Oct 27 01:34:47.427041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 463/935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:47 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:48.450828 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:48.451440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:48.457692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:48.458172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:48.458608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:48.459297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:48.459751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:48.460177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:48.553793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:48.567918 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cc0e7fce-a5a3-48d4-9a97-97773b9d00f3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1317 microversion: 2.1 time: 0.121566 Oct 27 01:34:48.568497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 473/936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:48 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1317 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:49.592050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:49.592656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:49.598589 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:49.599070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:49.599505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:49.600185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:49.600645 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:49.601144 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:49.754121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:49.764179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a64b8074-f68d-4a18-9d9c-300d21453bb2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.176010 Oct 27 01:34:49.765472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 464/937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:49 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:50.787985 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:50.789205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:50.795430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:50.795991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:50.796500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:50.797597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:50.803252 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:50.803951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:50.962727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:50.970531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-11df5a9f-edd9-4e05-b3fd-2d754c7ba455 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.186452 Oct 27 01:34:50.985442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 474/938] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:50 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:51.996122 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:51.997558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:52.004832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:52.005755 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:52.006458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:52.008662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:52.009407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:52.010085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:52.150494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:52.158168 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b7209544-8319-4a5d-880c-91c21e3bbfb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.167389 Oct 27 01:34:52.158738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 465/939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:51 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:53.182993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:53.183680 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:53.190394 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:53.190885 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:53.191308 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:53.192003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:53.192449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:53.192885 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:53.327701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:53.335895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-31c85615-9699-456e-9935-e7b96ca85b62 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.157813 Oct 27 01:34:53.337331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 475/940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:53 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:54.358820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:54.359435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:54.365875 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:54.366356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:54.366818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:54.367511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:54.367955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:54.368377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:54.508757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:54.516671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5a739737-8e0c-4cb8-8bd0-ba50dac58a10 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.161587 Oct 27 01:34:54.517353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 466/941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:54 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:55.541548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:55.543702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:55.551089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:55.551951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:55.552780 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:55.553750 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:55.555089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:55.555956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:55.693016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:55.703678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-90ed5993-c92d-46bf-8a97-9f3fa2bce60e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.165942 Oct 27 01:34:55.704545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 476/942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:55 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:56.727621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:56.728261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:56.734750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:56.735233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:56.735666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:56.736372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:56.736829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:56.737273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:56.878176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:56.886289 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-870885ab-de88-4e1d-b652-27c7d711ffc2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.163229 Oct 27 01:34:56.886835 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 467/943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:56 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:57.909561 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:57.910180 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:57.912572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:57.913257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:57.919421 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:57.919897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:57.920340 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:57.921032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:57.921517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:57.921946 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:58.055318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:58.062935 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-010a90a1-9a52-4484-8c78-f7b11b9dfbbc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.157350 Oct 27 01:34:58.063494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 477/944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:57 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:34:59.086354 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:34:59.087079 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:34:59.088918 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:34:59.094603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:59.095087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:59.095527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:59.096274 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:34:59.096738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:34:59.097193 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:34:59.226400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:34:59.234205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-abf280d3-cc5c-40b7-814f-6f60c63e10b8 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.152489 Oct 27 01:34:59.234775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 468/945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:34:59 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:00.258450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:00.259070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:00.265412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:00.265886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:00.266315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:00.266995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:00.267439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:00.267857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:00.401404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:00.409144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a5b0febf-485d-474f-b3cb-8502f6901a25 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.155101 Oct 27 01:35:00.409706 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 478/946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:00 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:01.432477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:01.433108 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:01.439483 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:01.439961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:01.440395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:01.441097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:01.441550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:01.441974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:01.604420 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:01.612909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5114fe13-4b00-423e-a9e3-aed3624e74e6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.184859 Oct 27 01:35:01.613565 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 469/947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:01 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:02.331178 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:02.341595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:02.342065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:02.342491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:02.353916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] Creating event network-changed:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:35:02.358874 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-6454febd-a88b-4de8-8940-a3d5342e87db req-0bb8bcbd-7bda-408f-88fb-a3eb0c2d8d1c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162525 Oct 27 01:35:02.359458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 479/948] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:02.636708 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:02.637397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:02.644601 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:02.645175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:02.645651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:02.646377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:02.646914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:02.647410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:02.786634 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:02.794944 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-bd9f4e9f-31ad-44b4-941f-b22ce92d4aa3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.162575 Oct 27 01:35:02.795508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 470/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:02 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:03.819001 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:03.819695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:03.826351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:03.826821 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:03.827245 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:03.827925 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:03.828371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:03.828788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:03.959789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:03.967381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d9f8a62f-933d-47fc-b8b0-c65a24505948 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.152549 Oct 27 01:35:03.967947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 480/950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:03 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:04.990296 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:04.990830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:04.997372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:04.997850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:04.998295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:04.998952 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:04.999399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:04.999816 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:05.124033 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:05.131539 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e2ac97c0-8797-44c6-b2a2-48615297c075 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.145190 Oct 27 01:35:05.132087 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 471/951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:04 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:06.154344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:06.154961 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:06.161325 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:06.161815 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:06.162259 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:06.162955 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:06.163411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:06.164449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:06.291694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:06.299585 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-871c4d5f-c503-4f54-8e3f-caa6e00f27ca tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.149091 Oct 27 01:35:06.300157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 481/952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:06 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:07.322858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:07.323464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:07.329908 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:07.330385 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:07.330821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:07.331514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:07.331965 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:07.332388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:07.459049 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:07.467125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3b6f424e-2444-475a-9b11-68b5fd3139aa tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.148214 Oct 27 01:35:07.467688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 472/953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:07 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:08.490096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:08.490702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:08.497636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:08.498113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:08.498564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:08.499256 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:08.499703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:08.500120 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:08.628682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:08.636732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-66d5e16f-49b7-4835-8518-38a53398b39c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.150497 Oct 27 01:35:08.637320 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 482/954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:08 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:09.659972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:09.660615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:09.667707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:09.668190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:09.668629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:09.669346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:09.669803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:09.670231 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:09.800943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:09.809186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dbd44eb9-495f-4b3e-a50e-620718c7b2a2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.153019 Oct 27 01:35:09.809751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 473/955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:09 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:10.831721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:10.832323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:10.839689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:10.840164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:10.840594 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:10.841309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:10.841754 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:10.842174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:10.968212 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:10.975807 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9c2cb71a-d0bc-4d7e-bbb1-6aebd94d2d3b tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.147949 Oct 27 01:35:10.976747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 483/956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:10 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:11.998476 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:11.999110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:12.005628 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:12.006104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:12.006544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:12.007227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:12.007676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:12.008095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:12.145241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:12.153433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-168cc12a-8528-45aa-98ce-b814e485aeb5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.158769 Oct 27 01:35:12.153994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 474/957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:11 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:13.176219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:13.176835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:13.183957 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:13.186172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.186984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.187967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:13.188886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.189998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.190634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:13.220943 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:13.486382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:13.494845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e8836ded-9133-4969-a004-ff47f1a67d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.322630 Oct 27 01:35:13.496260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 484/958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:13 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:13.866194 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:13.866694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:13.873728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.874228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.874655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:13.875334 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.875776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.876193 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:13.904660 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b9e491d3-f98b-43fd-a24f-8910b9bd9469 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments/237ef937-4b77-420a-a8fd-9e6021b59c55" status: 200 len: 194 microversion: 2.20 time: 0.042461 Oct 27 01:35:13.905257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 475/959] 10.222.0.42 () {60 vars in 1454 bytes} [Thu Oct 27 01:35:13 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments/237ef937-4b77-420a-a8fd-9e6021b59c55 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:13.978928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:13.979430 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:13.985395 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.985877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.986309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:13.986994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:13.987441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:13.987864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:14.067173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lazy-loading 'services' on Instance uuid b414d9ca-9bc2-4101-953a-4f866cf4326f {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:35:14.138135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e3a45556-7431-44fd-859c-da5290328c98 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments/237ef937-4b77-420a-a8fd-9e6021b59c55" status: 202 len: 0 microversion: 2.20 time: 0.163554 Oct 27 01:35:14.138805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 485/960] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Oct 27 01:35:13 2022] DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments/237ef937-4b77-420a-a8fd-9e6021b59c55 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:35:14.147768 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:14.150597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:14.156378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:14.156853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:14.157316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:14.157992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:14.158437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:14.158854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:14.189349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f3003452-7510-43b9-bc61-437ab3f21c49 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045567 Oct 27 01:35:14.189878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 476/961] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:14 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:14.518859 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:14.519558 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:14.526393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:14.526882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:14.527316 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:14.528008 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:14.528456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:14.528877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:14.660101 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:14.667717 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6ad8a143-ce87-46c3-b01b-8fad891a863f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.153226 Oct 27 01:35:14.668282 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 486/962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:14 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:15.202246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:15.204361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:15.211364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:15.212007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:15.212451 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:15.213166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:15.213621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:15.214046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:15.243643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-73c550db-3c37-4ff4-8f78-1a423846e660 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045380 Oct 27 01:35:15.244186 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 477/963] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:15 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:15.690806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:15.691411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:15.698826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:15.699305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:15.699735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:15.700424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:15.700873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:15.701330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:15.833283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:15.840950 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2f3dcc80-b796-45a6-a47a-c7c2c5371973 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.154222 Oct 27 01:35:15.841536 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 487/964] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:15 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:16.256025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:16.258304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:16.264690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:16.265208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:16.265648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:16.266327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:16.266775 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:16.267196 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:16.296208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-29217742-1a0f-4b01-8a66-fad8baafe3f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044141 Oct 27 01:35:16.296713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 478/965] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:16 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:16.863760 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:16.864417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:16.871601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:16.872078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:16.872511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:16.873233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:16.873687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:16.874114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:16.998358 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:17.006038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4ae80c2a-a0d9-4586-8900-e713025aa0d3 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.146232 Oct 27 01:35:17.006613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 488/966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:16 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:17.308988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:17.311418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:17.313756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:17.319780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:17.320440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:17.320904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:17.321639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:17.322091 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:17.322519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:17.326621 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=91 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:17.354838 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-862d5b3f-aabb-4028-92b0-ad51ce54f79a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049793 Oct 27 01:35:17.355316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 479/967] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:17 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:18.028994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:18.029633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:18.036097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:18.036576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:18.037045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:18.037757 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:18.038201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:18.038620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:18.171393 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:18.179831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fd0ca46a-480b-43c3-9d12-b8f5a0a51547 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.154180 Oct 27 01:35:18.180431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 489/968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:18 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:18.366706 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:18.368986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:18.375335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:18.375825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:18.376264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:18.376969 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:18.377571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:18.378003 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:18.409655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f7f90ed0-80c6-48bf-887f-f6a04eadf27d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046989 Oct 27 01:35:18.410219 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 480/969] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:18 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:18.487620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "name": "network-vif-plugged", "status": "completed", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:18.497426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:18.498149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:18.498746 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:18.510940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] Creating event network-vif-plugged:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:35:18.515905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-cdddc700-4ade-4e90-81af-a468c496febf req-c312aad9-74da-4498-8028-8ea81ca21614 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086514 Oct 27 01:35:18.516655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 490/970] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:19.203250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:19.203854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:19.209862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:19.210331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:19.210757 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:19.211431 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:19.211877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:19.212297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:19.343271 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:19.354358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-caa8ce36-f091-418d-aae5-9f367071a040 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.155444 Oct 27 01:35:19.354921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 481/971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:19 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:19.423624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:19.425833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:19.431881 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:19.432353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:19.432777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:19.434309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:19.434764 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:19.435306 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:19.464447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4323a715-62fc-4abf-926d-1f33a2f3ca91 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046329 Oct 27 01:35:19.465021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 491/972] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:19 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:20.377040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:20.377608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:20.384051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.384534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.384971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.385685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.386136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.386558 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.476723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:20.478908 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:20.485790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.486277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.486718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.487415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.487869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.488297 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.518323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:20.519586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9cd39ad1-a04e-4f18-a151-342fa19bc462 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046785 Oct 27 01:35:20.520405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 492/973] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:35:20 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:20.526397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b13c9f98-8f01-4362-98ee-ae3b64de27c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1357 microversion: 2.1 time: 0.153262 Oct 27 01:35:20.526963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 482/974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:20 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:20.583236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:20.583725 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:20.589479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.589953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.590384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.591763 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.592211 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.592629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.617239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:35:20.690028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-353adaf8-9000-4d88-927b-68dd76f55a61 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 204 len: 0 microversion: 2.20 time: 0.110352 Oct 27 01:35:20.690604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 493/975] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 01:35:20 2022] DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:35:20.698909 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:20.699522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:20.706047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.706533 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.706974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.707662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:20.708121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:20.708551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:20.857487 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:20.865560 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:20.866996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:20.868151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-14d39618-c488-4e05-8729-370b9669ee10 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.173110 Oct 27 01:35:20.868707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 483/976] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:20 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:21.550892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:21.551598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:21.557928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.558413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.558848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.560164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.560640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.561157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.688389 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:21.696019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f2af3e03-37cd-4e3f-86e0-e6eb99ce05e7 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1547 microversion: 2.1 time: 0.149603 Oct 27 01:35:21.696577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 494/977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:21 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:21.718904 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:21.719509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:21.725872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.726348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.726780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.727465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.727912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.728330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.860167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:21.868832 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ace62a1b-bd43-4cd3-93a5-4ee6f2045bdb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1547 microversion: 2.1 time: 0.154308 Oct 27 01:35:21.869430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 484/978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:21 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:21.869601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:21.870175 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:21.876507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.876986 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.877458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.878150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.878602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.879025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.890276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:21.895145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:21.895801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Searching by: {'deleted': False, 'project_id': '9e496297038149beb8bfe69c53234988'} {{(pid=118905) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 01:35:21.902372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.902850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.903804 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.904666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:21.905141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:21.905571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:21.967153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lazy-loading 'services' on Instance uuid 77a88755-9cac-418c-b267-32d0b4cf6bb3 {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:35:21.996822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.multi_cell_list [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118905) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 01:35:22.038582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-70d75dee-b2ae-4c13-ba14-111ea8b0f12b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3/os-volume_attachments/74ef6268-7047-441e-bd3f-d12b5683cca6" status: 202 len: 0 microversion: 2.1 time: 0.172681 Oct 27 01:35:22.039173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 495/979] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:35:21 2022] DELETE /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3/os-volume_attachments/74ef6268-7047-441e-bd3f-d12b5683cca6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 01:35:22.046806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:22.047626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:22.055460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:22.056118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:22.056628 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:22.057409 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:22.057973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:22.058404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:22.096833 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-62d45244-1f3a-4799-876b-3e7a735099e1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210255 Oct 27 01:35:22.097454 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 485/980] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Oct 27 01:35:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:35:22.108878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:22.109519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:22.115520 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:22.116016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:22.116508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:22.117286 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:22.117740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:22.118181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:22.251907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:22.260059 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:22.261627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:22.263484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b4c74273-4045-4a24-8b2b-faab2fd7b47a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.220536 Oct 27 01:35:22.264015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 496/981] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:22 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:22.277575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:22.285986 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b43eb70b-4fa2-4791-94e0-a20a021e86cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1547 microversion: 2.1 time: 0.180884 Oct 27 01:35:22.286546 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 486/982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:22 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1547 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:23.288708 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:23.289326 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:23.295812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:23.296289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:23.296716 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:23.297439 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:23.297911 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:23.298579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:23.426824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:23.435816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:23.437305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:23.438492 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d859d59f-7b27-4699-aa78-f157ef7aeedb tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1722 microversion: 2.20 time: 0.153741 Oct 27 01:35:23.440510 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 497/983] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:23 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:23.836559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "600d5c7d-3c9a-429d-ae06-5a05cd3ff01b"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:23.838895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:23.845905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:23.846386 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:23.846820 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:23.847512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:23.847959 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:23.848381 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.127373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-164d2d63-5b98-4424-860b-84abe51c8e0f tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295482 Oct 27 01:35:24.128746 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 487/984] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:35:23 2022] POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:24.239571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:24.240075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:24.246069 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.246934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.248261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.249214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.249742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.250090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.265711 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:24.276993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:35:24.368190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c77dc7d1-989d-401f-a086-2d46b7979880 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "DELETE /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 204 len: 0 microversion: 2.1 time: 0.132353 Oct 27 01:35:24.368916 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 498/985] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:35:24 2022] DELETE /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:35:24.379739 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:24.380521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:24.388763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.389301 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.389913 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.390697 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.391125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.391507 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.455372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b414d9ca-9bc2-4101-953a-4f866cf4326f", "name": "network-vif-deleted", "tag": "431f71c8-f037-4a0b-8ada-368547d086d1"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:24.466042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.466520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.466952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.481330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] Creating event network-vif-deleted:431f71c8-f037-4a0b-8ada-368547d086d1 for instance b414d9ca-9bc2-4101-953a-4f866cf4326f on hv-cinder-81558 Oct 27 01:35:24.488011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-dcd4b867-af9f-4dc4-8891-43d206074122 req-0689438c-6954-48d7-937c-8de542415337 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Oct 27 01:35:24.489288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 499/986] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:24.503230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:24.504211 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:24.514613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.515237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.515919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.516927 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:24.517769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:24.518381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:24.560159 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:24.570509 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-20c45183-89a3-4859-ac9f-87d091f06958 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1513 microversion: 2.1 time: 0.195970 Oct 27 01:35:24.571670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 488/987] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:24 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:24.590748 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:24.600142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:24.601641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:24.603064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8fc29b23-0c7b-4aa1-b759-9fab12f3198b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1655 microversion: 2.20 time: 0.112437 Oct 27 01:35:24.603617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 500/988] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:24 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:25.595860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:25.596510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:25.603337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:25.603945 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:25.604513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:25.605228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:25.605674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:25.606149 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:25.631808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:25.632446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:25.640038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:25.640525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:25.641179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:25.642069 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:25.642513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:25.643105 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:25.727778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:25.738602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:25.740384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:25.741928 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-30151e67-9e95-4b81-9aba-d87bba1b07e7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 200 len: 1655 microversion: 2.20 time: 0.114931 Oct 27 01:35:25.750855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 501/989] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:25 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 1655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:25.776624 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:25.784568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d52cd928-4b43-41cd-aa81-19726652c5a1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1513 microversion: 2.1 time: 0.192968 Oct 27 01:35:25.785151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 489/990] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:25 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:26.768257 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:26.768878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:26.775397 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:26.775879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:26.776310 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:26.776998 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:26.777490 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:26.777905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:26.792004 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f HTTP/1.1 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:35:26.793678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:35:26.795529 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'b414d9ca-9bc2-4101-953a-4f866cf4326f'} Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:35:26.797026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:35:26.798879 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:35:26.800826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:35:26.800826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6f627299-4f18-4c4a-a96c-7287cd52a6ab tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 404 len: 111 microversion: 2.20 time: 0.030724 Oct 27 01:35:26.800826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 502/991] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:26 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:35:26.806978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-bf3cb0f9-70a0-44aa-90e2-e0ae43350267 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '.version_select at 0x7f6c12ff5a60>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:26.809290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:26.810484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:26.818040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:26.818721 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:26.819314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:26.820484 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:26.821944 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:26.822540 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:26.827747 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-bf3cb0f9-70a0-44aa-90e2-e0ae43350267 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-326093205" status: 204 len: 0 microversion: 2.20 time: 0.026227 Oct 27 01:35:26.828432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 490/992] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Oct 27 01:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-326093205 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:35:27.027857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:27.047983 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7f9ded36-677e-4258-a291-56726a91e2af tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 200 len: 1513 microversion: 2.1 time: 0.241300 Oct 27 01:35:27.048853 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 503/993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:26 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:27.146081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a88755-9cac-418c-b267-32d0b4cf6bb3", "name": "network-vif-deleted", "tag": "916c39b7-b2b2-4248-bcce-53ebf91190cb"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:27.159687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:27.160145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:27.160773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:27.171633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] Creating event network-vif-deleted:916c39b7-b2b2-4248-bcce-53ebf91190cb for instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 on hv-cinder-81558 Oct 27 01:35:27.178103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-128bf907-f130-43e5-abfd-5ca3055b3931 req-c8df0a08-4192-43cc-9ee3-ee4aa24282d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036441 Oct 27 01:35:27.181434 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 491/994] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:35:27.507817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: .version_select at 0x7f6c12e6d040>, body: {"keypair": {"name": "tempest-keypair-1822649507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUEcbKjSFkKnJcXhYGCu7p9qFr9I3Vw5F115ZebkkpawLLGYRGK/76QOZQKEBJ4g2qZk1Dr1ccwMI+yMOXp1aH6V+HNsbFzmWYWUNyygPZUwahKRQQEuG9aqG7SVOS7Fw=="}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:27.523699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for project 73c30908c04242e28297b339bfcc5600. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:35:27.527480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for user 608f1351ab84402d8634ba99b6e26323 and project 73c30908c04242e28297b339bfcc5600. Resources: {'key_pairs'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:35:27.539712 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [d68557bb-acb5-47b9-b1ef-3a446b20d200] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 01:35:28.071671 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:28.072402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 77a88755-9cac-418c-b267-32d0b4cf6bb3] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:28.079638 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:28.080116 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:28.081273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:28.081273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:28.081718 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:28.082137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:28.095769 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] HTTP exception thrown: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Request method failure captured: Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 HTTP/1.1 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWeAOJD3vpDiT1eg1L5pdnYZdcFuloNv3w-inqWKj-TsC0Urz-2R0SCFbpuY_vr9m1kFkmT-3nHjfSExMjtNtBRd_FEXrEJ_KiDkAgV_Nq9YUS7gIpYuFdzMxb0-cReTtjUvUrcnz1CIMeFscbjg79iaVbBi09qWp_yzt1k4pyRNsLiY Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 176e5a3c112e4967a83375c948008ab5 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:35:28.097446 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_176e5a3c112e4967a83375c948008ab5", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 176e5a3c112e4967a83375c948008ab5 Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesSnapshotTestJSON-1799608619-project Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 2321134e938247b09711047a12b86382 Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799608619-project Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. Oct 27 01:35:28.099114 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '77a88755-9cac-418c-b267-32d0b4cf6bb3'} Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:35:28.100118 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. Oct 27 01:35:28.101616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:35:28.102955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Returning 404 to user: Instance 77a88755-9cac-418c-b267-32d0b4cf6bb3 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:35:28.102955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-00d60296-ca22-4003-a2da-8c0016f8ea9d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3" status: 404 len: 111 microversion: 2.1 time: 0.031948 Oct 27 01:35:28.102955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 492/995] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:28 2022] GET /compute/v2.1/servers/77a88755-9cac-418c-b267-32d0b4cf6bb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:35:28.547400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [d68557bb-acb5-47b9-b1ef-3a446b20d200] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57710. Oct 27 01:35:28.564007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a1ab6847-5d12-4c46-89dc-b26787a124ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.059664 Oct 27 01:35:28.564267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 504/996] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Oct 27 01:35:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1061 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 01:35:29.825444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-839503650", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8936d5a-77c4-48b0-9095-ed36ec7d5242"}], "security_groups": [{"name": "tempest-securitygroup--1265986886"}], "key_name": "tempest-keypair-1822649507", "user_data": "}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:29.928566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.network.neutron [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] validate_networks() for [('f8936d5a-77c4-48b0-9095-ed36ec7d5242', None, None, None, None, None)] {{(pid=118905) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:35:30.383268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Flavor limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:35:30.383688 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Image limits 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:35:30.384153 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Flavor pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:35:30.384557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Image pref 0:0:0 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:35:30.384962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.virt.hardware [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118905) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:35:30.394263 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:30.394740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:30.395170 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:30.395896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:30.396344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:30.396768 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:30.413631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for project 73c30908c04242e28297b339bfcc5600. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:35:30.417470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Getting quotas for user 608f1351ab84402d8634ba99b6e26323 and project 73c30908c04242e28297b339bfcc5600. Resources: {'instances', 'cores', 'ram'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:35:30.428418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Going to run 1 instances... {{(pid=118905) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:35:30.430641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118905) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:35:30.477221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1c06a8a7-f2fc-4175-bca6-c55a3aada626 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.656189 Oct 27 01:35:30.477869 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 493/997] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Oct 27 01:35:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 01:35:30.489769 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:30.490465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:30.561820 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:30.576480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:30.578653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:30.579814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dbda9421-96ef-4e62-a095-dbd80d74399e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1281 microversion: 2.20 time: 0.094544 Oct 27 01:35:30.580355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 505/998] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:30 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:31.604267 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:31.604874 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:31.612945 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:31.613406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:31.613842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:31.614571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:31.615024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:31.615450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:31.676227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:31.684243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:31.685722 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:31.686871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2b012bc9-e0ba-4d53-84b7-0a695bb03ff2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1285 microversion: 2.20 time: 0.087154 Oct 27 01:35:31.687427 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 494/999] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:31 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:32.711718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:32.712351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:32.719400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:32.719894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:32.720332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:32.721039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:32.721578 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:32.722011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:32.788991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:32.798072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:32.799903 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:32.801140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-32040600-a284-4881-801e-ae332ba184ce tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1277 microversion: 2.20 time: 0.093261 Oct 27 01:35:32.801907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 506/1000] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:32 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:33.827047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:33.827778 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:33.854353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:33.854922 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:33.855293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:33.856013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:33.856473 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:33.859893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:33.921491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:33.922106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:33.928960 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:33.929464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:33.929900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:33.930596 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:33.931047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:33.931473 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:33.943866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:33.953181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:33.954612 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:33.955751 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dad681aa-cf14-4df4-a33b-8223ff427219 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1339 microversion: 2.20 time: 0.133151 Oct 27 01:35:33.963823 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 495/1001] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:33 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:34.130157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:34.143182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-af81ccbc-41a2-47d0-9714-777e2a15cfeb tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1593 microversion: 2.1 time: 0.226066 Oct 27 01:35:34.143822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 507/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:33 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1593 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:34.981957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:34.982569 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:34.990923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:34.991592 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:34.992171 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:34.993052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:34.993542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:34.993963 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:35.181175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:35.189576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:35.191222 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:35.192448 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-91822218-dd0b-4ee3-a4ec-dbd9acb062c2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.214925 Oct 27 01:35:35.193145 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 496/1003] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:34 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:35.263424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:35.273434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:35.273919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:35.274390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:35.287634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] Creating event network-changed:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:35:35.291989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-97e9976e-af19-4c90-b3ef-ebad1494fbd8 req-689ca88f-7be0-47fb-8a73-7f2735c02a03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Oct 27 01:35:35.292591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 508/1004] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:35.913593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:35.923340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:35.924147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:35.924641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:35.929457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:35.940095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] Creating event network-changed:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:35:35.948371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-23e9cf15-7c9e-41a6-ba1f-5123c4b8284c req-d1720d8d-1ed8-4d67-9257-a345710162aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132052 Oct 27 01:35:35.950073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 497/1005] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:36.219958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:36.220972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:36.227231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:36.228020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:36.228728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:36.229505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:36.230270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:36.230898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:36.427398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:36.436056 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:36.443064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:36.444612 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-20c50f40-14a3-4421-ab19-1f263239b060 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.230813 Oct 27 01:35:36.462684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 509/1006] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:36 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:36.965484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1539203924"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:36.966130 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:36.972968 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:36.973611 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:36.974047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:36.974736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:36.975180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:36.975598 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.103664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.network.security_group_api [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Adding security group 1670db2e-3851-4042-bc05-508ead4b005e to port f8228812-5eef-44c7-8163-dcef9ae06091 Oct 27 01:35:37.478790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:37.479527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:37.486328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:37.486812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:37.487250 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.487953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:37.488434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:37.488862 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.779246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-46f787f2-b967-4078-8ecb-6a4968eab299 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action" status: 202 len: 0 microversion: 2.1 time: 0.818866 Oct 27 01:35:37.779935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 498/1007] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:35:36 2022] POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:35:37.788819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:37.789450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:37.795325 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:37.795805 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:37.796919 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.797651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:37.798107 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:37.798819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.863373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:37.871391 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:37.872831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:37.874034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-497b0a9e-0d2b-46a7-a305-57fcffd21076 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.399190 Oct 27 01:35:37.885231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 510/1008] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:37 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:37.891319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:37.902139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:37.902892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:37.903707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:37.931396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] Creating event network-changed:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:35:37.970534 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-70798914-3f62-4474-bf89-d73031c1e374 req-6f9a37c4-9651-49ac-8fe7-fae6a463efe8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078570 Oct 27 01:35:37.972060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 511/1009] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:38.107112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:38.126177 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-aad36a1f-e7eb-4da1-a25e-93d1da782199 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1640 microversion: 2.1 time: 0.340130 Oct 27 01:35:38.126791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 499/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:37 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1640 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:38.160217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-85270112", "imageRef": "3358ed9e-09eb-42df-b4b9-09d51eb8f0a1", "flavorRef": "452", "networks": [{"uuid": "9bca76cc-1d50-4e49-963d-abcefbafe61e"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:38.220702 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] validate_networks() for [('9bca76cc-1d50-4e49-963d-abcefbafe61e', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:35:38.837344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:35:38.837963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:35:38.838339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:35:38.838759 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:35:38.839170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:35:38.849418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:38.849901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:38.850595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:38.851398 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:38.852068 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:38.852503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:38.871461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Getting quotas for project 176e5a3c112e4967a83375c948008ab5. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:35:38.876374 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Getting quotas for user 2321134e938247b09711047a12b86382 and project 176e5a3c112e4967a83375c948008ab5. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:35:38.888075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:35:38.891037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3358ed9e-09eb-42df-b4b9-09d51eb8f0a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:35:38.900463 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:38.901236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:38.908255 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:38.908752 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:38.909260 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:38.909990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:38.910515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:38.911074 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:38.941565 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-415e313f-ea8f-4818-9339-442b599cbfed tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787598 Oct 27 01:35:38.942505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 512/1011] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:35:38.953846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f89cdbcb-d799-4726-b154-58e86be28c8e tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:38.954462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f89cdbcb-d799-4726-b154-58e86be28c8e tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:39.032601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f89cdbcb-d799-4726-b154-58e86be28c8e tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:39.039761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f89cdbcb-d799-4726-b154-58e86be28c8e tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1217 microversion: 2.1 time: 0.089925 Oct 27 01:35:39.040666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 513/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:38 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:35:39.094738 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:39.103055 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:39.104689 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:39.105901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-92941ed0-8ba4-4e2d-89d7-f6adaca57d97 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.209475 Oct 27 01:35:39.109224 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 500/1013] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:38 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:40.063857 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:40.064462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:40.066896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:40.072875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:40.073374 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:40.073811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:40.074505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:40.074953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:40.075372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:40.131496 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:40.132095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:40.138756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:40.139236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:40.139667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:40.141313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:40.142085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:40.142515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:40.167890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:40.181095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-39b90e65-866f-4f20-8ff0-73189955f689 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1221 microversion: 2.1 time: 0.121428 Oct 27 01:35:40.182122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 514/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:40 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:40.301849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:40.309856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:40.311299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:40.313355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d9ea25b3-566d-4d21-90c7-1c2629625613 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.186070 Oct 27 01:35:40.313915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 501/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:40 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:41.212028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:41.212626 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:41.220335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:41.220819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:41.221460 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:41.222365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:41.222819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:41.223239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:41.303627 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:41.311237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bb558c7b-552c-4e12-8fe7-8a1e464422ce tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1269 microversion: 2.1 time: 0.103184 Oct 27 01:35:41.311789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 515/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:41 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:41.338748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:41.339352 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:41.341309 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:41.341972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=6 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:41.348502 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:41.348979 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:41.349437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:41.350121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:41.350574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:41.350997 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:41.478104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:41.486559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:41.488004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:41.489112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-671da4d0-14f9-49fc-8794-7832ebd7db75 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.154165 Oct 27 01:35:41.489668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 502/1017] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:41 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:42.334762 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:42.335377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:42.342590 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:42.343307 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:42.343835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:42.344654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:42.345140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:42.345577 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:42.514644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:42.515488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:42.521871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:42.522349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:42.522785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:42.523479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:42.523931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:42.524358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:42.545608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:42.554920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-38253460-ab4d-47b4-b136-a34728b90df1 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.224066 Oct 27 01:35:42.555640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 516/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:42 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:42.768911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:42.776891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:42.778361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:42.779490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b22363be-714f-4b05-b2d4-07b2fc3d18a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.268809 Oct 27 01:35:42.780046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 503/1019] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:42 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:43.161373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b03558-6f5c-4a9f-a66b-5a61833a946a", "tag": "80788282-5235-455c-94d9-b233c700101a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:43.171124 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.173190 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.174026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.185686 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] Creating event network-changed:80788282-5235-455c-94d9-b233c700101a for instance 19b03558-6f5c-4a9f-a66b-5a61833a946a on hv-cinder-81558 Oct 27 01:35:43.192049 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-33ecdea9-f1ea-4fe9-9914-db674eb6010d req-565cfa18-60e6-4020-ad0f-adfb06f2718e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034381 Oct 27 01:35:43.192786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 517/1020] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:43.579014 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:43.579765 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:43.586521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.587083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.587580 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.588341 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.588865 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.589373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.735106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:43.742763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1f8f861e-a85f-4c16-80a2-e5d2ffd08e52 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.167641 Oct 27 01:35:43.743327 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 504/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:43 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:43.748136 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "name": "network-vif-plugged", "status": "completed", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:43.760644 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.761209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.761595 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.775179 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] Creating event network-vif-plugged:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:35:43.780213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-a34bc5b7-9fab-4dc9-8791-68bbbc14cad9 req-b96b0ea3-9166-4e17-b635-ad0a530e7c6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037431 Oct 27 01:35:43.781399 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 518/1022] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:35:43.806125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:43.806740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:43.814002 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.814530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.814950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.815629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:43.816088 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:43.816522 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:43.957881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:43.966121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:43.967574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:43.969318 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3429ffe9-a50c-4c53-969e-aa8c341b3e64 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.167537 Oct 27 01:35:43.969983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 505/1023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:43 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:44.767420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:44.768110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:44.774360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:44.774845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:44.775278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:44.775976 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:44.776425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:44.776848 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:44.930804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:44.938420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-df55f72c-8f28-47a3-8f85-ba6ba8e2bdfe tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.175768 Oct 27 01:35:44.938978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 519/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:44 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:44.995245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:44.995875 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:45.003514 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:45.004000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:45.004435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:45.005156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:45.005610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:45.006035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:45.142683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:45.150632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:45.152075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:45.153242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4d6e3eba-4c2e-433c-b45b-5d7890ce2b0e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.162427 Oct 27 01:35:45.153806 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 506/1025] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:44 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:45.965505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:45.966120 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:45.973221 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:45.973710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:45.974149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:45.974844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:45.975298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:45.975727 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:46.180355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:46.181644 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:46.188637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:46.189220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:46.189664 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:46.190377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:46.191100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:46.191611 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:46.488369 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:46.496108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1960fcb6-bb1c-47d9-9f00-325c95a9a5ad tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.535383 Oct 27 01:35:46.513920 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 520/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:45 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:46.586894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:46.594977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:46.596416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:46.597555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-18b10478-abd0-4ced-bea9-61227c98202f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.421849 Oct 27 01:35:46.598115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 507/1027] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:46 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:35:47.521162 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:47.521795 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:47.528411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:47.528900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:47.529390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:47.530106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:47.530564 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:47.531654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:47.534382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:47.623088 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:47.623724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:47.627307 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:47.636822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:47.637435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:47.637939 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:47.638720 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:47.639396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:47.639891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:47.681024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:47.694533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-164bedd3-6cde-450b-ac30-a2cbcfe5a172 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.177382 Oct 27 01:35:47.709684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 521/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:47 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:47.779159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b03558-6f5c-4a9f-a66b-5a61833a946a", "name": "network-vif-plugged", "status": "completed", "tag": "80788282-5235-455c-94d9-b233c700101a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:47.782235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:47.791222 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:47.791787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:47.792366 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:47.795330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:47.805835 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] Creating event network-vif-plugged:80788282-5235-455c-94d9-b233c700101a for instance 19b03558-6f5c-4a9f-a66b-5a61833a946a on hv-cinder-81558 Oct 27 01:35:47.807045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:47.808355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1831d7ff-adc3-4b42-8c9d-2f318e1a49a3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1407 microversion: 2.20 time: 0.189269 Oct 27 01:35:47.811075 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-74384232-5332-4ebc-944e-d824d60f47a9 req-4af2ac40-6f08-485d-b40d-f47688c2408c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036364 Oct 27 01:35:47.812071 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 522/1029] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:35:47.817153 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 508/1030] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:47 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:48.719882 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:48.720719 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:48.726669 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:48.727146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:48.727575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:48.728260 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:48.728710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:48.729158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:48.834362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:48.834966 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:48.841424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:48.842199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:48.842401 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:48.843101 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:48.844124 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:48.844562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:48.862526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:48.864831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:48.871781 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8b3fee3a-b2a7-46b3-a2e5-1f06bb3051a0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.157541 Oct 27 01:35:48.872348 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 523/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:48 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:48.974221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:48.982369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:48.983808 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:48.985129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ff285656-568c-46d8-a067-337a16623e23 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1598 microversion: 2.20 time: 0.154594 Oct 27 01:35:48.985727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 509/1032] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:35:48 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:35:49.009401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:49.009892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:49.016296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:49.016833 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:49.017296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:49.017981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:49.018431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:49.018854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:49.038351 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=14 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:35:49.097533 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f3d5aa7f-bca4-45c9-8ca6-11233009a415 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091910 Oct 27 01:35:49.098135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 524/1033] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Oct 27 01:35:49 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:35:49.894308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:49.894921 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:49.901041 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:49.901623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:49.902059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:49.902753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:49.903205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:49.903630 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:50.106793 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:50.118169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:50.118491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:50.118695 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:50.119060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:50.128652 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-91df1774-8f48-439e-a0af-718602bdff6b tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1317 microversion: 2.1 time: 0.237957 Oct 27 01:35:50.129562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 510/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:49 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:50.144182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] Creating event network-changed:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:35:50.149718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-ba7d333f-0ceb-4b7a-b295-173791b66f4a req-dc8990df-3f99-4c55-92f1-c7140311ca2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047455 Oct 27 01:35:50.150319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 525/1035] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:35:51.152490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:35:51.153125 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:51.165567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:51.166061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:51.166532 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:51.167364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:51.167821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:51.168245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:51.308719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:35:51.317029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-78fc7b90-4150-431d-a86d-81af55ea7579 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1505 microversion: 2.1 time: 0.168735 Oct 27 01:35:51.317740 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 511/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:35:51 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:35:51.341554 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092caaf5-295b-4ff3-97c7-be5e121f6eba", "device": "/dev/sdb"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:35:51.344570 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:35:51.350662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:51.351149 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:51.351592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:51.352288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:35:51.352748 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:35:51.353242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:35:51.614219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f8fdcfd2-bf03-41d3-9a98-b7ce19f65201 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "POST /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277128 Oct 27 01:35:51.614832 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 526/1037] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Oct 27 01:35:51 2022] POST /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:36:13.027421 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:13.027906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:13.030462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=7 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:13.031110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=83 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:13.037453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:13.037936 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:13.038374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:13.039105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:13.039562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:13.039988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:13.118315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lazy-loading 'services' on Instance uuid 19b03558-6f5c-4a9f-a66b-5a61833a946a {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:36:13.191220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-31b4e34d-f04a-4280-9f16-14ea8a57dbca tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "DELETE /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a/os-volume_attachments/092caaf5-295b-4ff3-97c7-be5e121f6eba" status: 202 len: 0 microversion: 2.1 time: 0.166443 Oct 27 01:36:13.191809 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 512/1038] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:36:13 2022] DELETE /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a/os-volume_attachments/092caaf5-295b-4ff3-97c7-be5e121f6eba => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:36:14.320449 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:14.321118 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:14.323613 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=25 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:14.324280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:36:14.331328 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:14.331838 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:14.332298 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:14.333000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:14.333491 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:14.333962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:14.359942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Going to try to terminate instance {{(pid=118906) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:36:14.432409 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-779b438f-3e71-4757-9950-bf776e11acb0 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "DELETE /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 204 len: 0 microversion: 2.1 time: 0.115773 Oct 27 01:36:14.433139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 527/1039] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:36:14 2022] DELETE /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:36:14.442557 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:14.443257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:14.449403 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:14.449881 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:14.450315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:14.451007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:14.451458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:14.451880 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:14.580456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:36:14.588750 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-51c0082c-4b4c-4aa9-89ae-945674e08a5d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1511 microversion: 2.1 time: 0.150956 Oct 27 01:36:14.589345 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 513/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:36:14 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:36:15.612942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:15.613662 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:15.619896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:15.620370 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:15.620796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:15.621511 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:15.621958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:15.622378 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:15.753864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:36:15.761754 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f5c338e5-aca0-45ab-ab19-bb093ea26c2d tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1511 microversion: 2.1 time: 0.153634 Oct 27 01:36:15.762322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 528/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:36:15 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:36:16.786235 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:16.787475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:16.794196 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:16.794686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:16.795256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:16.795951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:16.796426 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:16.796889 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:17.021276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2321134e938247b09711047a12b86382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '176e5a3c112e4967a83375c948008ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:36:17.028849 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-cf2451d7-c484-4b20-865b-ed53f6175c64 tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 200 len: 1511 microversion: 2.1 time: 0.247408 Oct 27 01:36:17.029431 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 514/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:36:16 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:36:17.210646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b03558-6f5c-4a9f-a66b-5a61833a946a", "name": "network-vif-deleted", "tag": "80788282-5235-455c-94d9-b233c700101a"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:36:17.220878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:17.221417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:17.221847 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:17.232730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] Creating event network-vif-deleted:80788282-5235-455c-94d9-b233c700101a for instance 19b03558-6f5c-4a9f-a66b-5a61833a946a on hv-cinder-81558 Oct 27 01:36:17.238158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-d211a782-f3ab-4473-8886-ae28ca174e9b req-0d02803d-09b6-48c6-9e77-a8d4292a1fc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Oct 27 01:36:17.238774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 529/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:36:18.053273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:36:18.053814 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] [instance: 19b03558-6f5c-4a9f-a66b-5a61833a946a] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:36:18.060020 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:18.060493 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:18.060923 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:18.061632 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:36:18.062075 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:36:18.062491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:36:18.076384 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] HTTP exception thrown: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Request method failure captured: Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a HTTP/1.1 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWeAOJD3vpDiT1eg1L5pdnYZdcFuloNv3w-inqWKj-TsC0Urz-2R0SCFbpuY_vr9m1kFkmT-3nHjfSExMjtNtBRd_FEXrEJ_KiDkAgV_Nq9YUS7gIpYuFdzMxb0-cReTtjUvUrcnz1CIMeFscbjg79iaVbBi09qWp_yzt1k4pyRNsLiY Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 176e5a3c112e4967a83375c948008ab5 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:36:18.078365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/176e5a3c112e4967a83375c948008ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_176e5a3c112e4967a83375c948008ab5", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 176e5a3c112e4967a83375c948008ab5 Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1799608619 Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-VolumesSnapshotTestJSON-1799608619-project Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 2321134e938247b09711047a12b86382 Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-VolumesSnapshotTestJSON-1799608619-project Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. Oct 27 01:36:18.080061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '19b03558-6f5c-4a9f-a66b-5a61833a946a'} Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:36:18.082481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. Oct 27 01:36:18.083777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:36:18.084915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] Returning 404 to user: Instance 19b03558-6f5c-4a9f-a66b-5a61833a946a could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:36:18.084915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d7ae0398-c464-4c8a-945d-b00fab5f6ace tempest-VolumesSnapshotTestJSON-1799608619 tempest-VolumesSnapshotTestJSON-1799608619-project] 10.222.0.42 "GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a" status: 404 len: 111 microversion: 2.1 time: 0.031718 Oct 27 01:36:18.084915 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 515/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:36:18 2022] GET /compute/v2.1/servers/19b03558-6f5c-4a9f-a66b-5a61833a946a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:37:16.224263 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:16.225003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:16.230012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:37:16.232390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:16.240471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:16.240947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:16.241479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:16.242782 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:16.243234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:16.243660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:16.314113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ab237153-84fb-47eb-986e-2a44e0a4153c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action" status: 202 len: 0 microversion: 2.1 time: 0.092082 Oct 27 01:37:16.317729 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 530/1045] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:37:16 2022] POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:37:16.323146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:16.323763 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:16.326893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=8 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:16.327660 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:16.334208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:16.334694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:16.335138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:16.335847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:16.336369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:16.336794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:16.533489 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:16.542238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f319e411-81a1-464e-b03f-ef8a97dff1cf tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1750 microversion: 2.1 time: 0.223193 Oct 27 01:37:16.542811 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 516/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:16 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:17.567109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:17.567802 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:17.574489 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:17.574968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:17.575509 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:17.576205 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:17.576650 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:17.577092 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:17.722017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:17.730553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9f7d9861-2927-4c5f-8a12-41e54bb92d7e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.168118 Oct 27 01:37:17.731107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 531/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:17 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:18.754072 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:18.754681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:18.761948 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:18.762447 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:18.762877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:18.763559 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:18.764007 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:18.764430 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:18.910721 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:18.918789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9f063802-a807-48c8-a82f-1f525545d9a6 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.168549 Oct 27 01:37:18.919349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 517/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:18 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:19.942929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:19.943538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:19.950637 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:19.951114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:19.951548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:19.952227 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:19.952672 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:19.953115 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:20.095318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:20.104164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0a77bdc7-8cdb-42aa-9f6c-714f7408481e tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.165033 Oct 27 01:37:20.104734 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 532/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:19 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:21.127583 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:21.128119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:21.134747 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:21.135229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:21.135669 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:21.136362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:21.136822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:21.137296 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:21.279275 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:21.287297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6c99cc3e-09aa-426b-8ade-ea8fb785679c tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.163692 Oct 27 01:37:21.287859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 518/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:21 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:22.311624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:22.312233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:22.318651 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:22.319135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:22.319572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:22.320318 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:22.321009 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:22.321494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:22.460569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:22.469392 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-63acffd7-f96a-4bf1-83ac-d647eebc8c06 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.161605 Oct 27 01:37:22.469958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 533/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:22 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:23.491859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:23.493110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:23.499464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:23.499942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:23.500373 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:23.501085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:23.501528 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:23.501951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:23.645787 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:23.654037 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a6d60e69-399f-4bdf-baa1-4f941c97be42 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.166061 Oct 27 01:37:23.654606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 519/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:23 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:24.677836 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:24.678446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:24.684937 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:24.685450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:24.685893 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:24.686583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:24.687034 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:24.687458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:24.828732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:24.836851 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cc879e3a-5e49-4962-b95f-218c192bd9c5 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.163151 Oct 27 01:37:24.837431 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 534/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:24 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:25.860293 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:25.860901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:25.867780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:25.868025 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:25.868461 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:25.869185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:25.869636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:25.870061 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:26.010414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:26.018615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d1309d83-bbb7-4bf6-806e-da2c044630dc tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.162298 Oct 27 01:37:26.019182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 520/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:25 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:27.043176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:27.043784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:27.050290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:27.050773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:27.051213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:27.051905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:27.052620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:27.053085 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:27.456814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:27.464929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-935602d1-65e4-4bd7-9b28-ffcc358bfead tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1755 microversion: 2.1 time: 0.426209 Oct 27 01:37:27.465520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 535/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:27 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1755 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:28.488033 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:28.488643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:28.495323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:28.495807 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:28.496247 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:28.496935 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:28.497418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:28.497867 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:28.643854 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:28.652608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9f976181-dbcb-4bd6-943f-6407fe3ae892 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1758 microversion: 2.1 time: 0.168425 Oct 27 01:37:28.653189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 521/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:37:28 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:37:32.540174 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:32.540666 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:32.546518 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:32.546996 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:32.547432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:32.548114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:32.548562 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:32.548983 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:32.572787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2a504fee-f472-4402-b78e-664aec18031a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/ips" status: 200 len: 150 microversion: 2.20 time: 0.250270 Oct 27 01:37:32.573375 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 536/1057] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Oct 27 01:37:32 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/ips => generated 150 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:37:34.396258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:37:34.396784 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:34.403733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:34.404209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:34.404637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:34.405344 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:34.405790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:34.406212 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:34.428947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lazy-loading 'flavor' on Instance uuid 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:37:34.649046 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e51f293e-760e-47e0-baac-03ab619701b3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/action" status: 202 len: 0 microversion: 2.20 time: 0.256761 Oct 27 01:37:34.649815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 522/1058] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 01:37:34 2022] POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:37:34.658814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:34.659485 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:34.666703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:34.667251 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:34.667787 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:34.669203 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:34.669708 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:34.670412 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:34.797972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:34.807601 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:34.809046 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:34.810258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9c56381d-69e6-46c2-bdf2-8367a85ec1e5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.155622 Oct 27 01:37:34.810805 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 537/1059] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:34 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:35.838567 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:35.839266 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:35.845455 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:35.845931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:35.846361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:35.847045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:35.847493 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:35.847917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:35.975306 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:35.983409 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:35.984859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:35.986050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b8e1da2a-05e8-4a45-93e8-6bc8f17d4700 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.153035 Oct 27 01:37:35.986610 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 523/1060] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:35 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:37.012403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:37.013003 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:37.019630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:37.020112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:37.020546 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:37.021273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:37.021728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:37.022154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:37.153218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:37.161178 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:37.162617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:37.163774 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-45c9991b-4e86-4cac-98fa-3fcf6d287bbf tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.155911 Oct 27 01:37:37.165039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 538/1061] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:37 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:38.190888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:38.191498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:38.198050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:38.198534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:38.198972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:38.199658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:38.200113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:38.200538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:38.326597 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:38.334600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:38.336545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:38.337732 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b6e62e14-b24a-48ac-ae0b-6f3937560095 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.150792 Oct 27 01:37:38.338299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 524/1062] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:38 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:39.363701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:39.364303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:39.371620 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:39.372097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:39.372526 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:39.373242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:39.373718 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:39.374107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:39.502503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:39.511357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:39.512811 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:39.514019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-21295aea-c383-4981-9ad5-a28e5e15238c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.154266 Oct 27 01:37:39.514580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 539/1063] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:39 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:40.539839 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:40.540450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:40.546886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:40.547363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:40.547792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:40.548467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:40.548911 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:40.549353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:40.677369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:40.686456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:40.687888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:40.689028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a5dfe953-8e9a-43e3-8302-01f62888ecb3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.153512 Oct 27 01:37:40.689602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 525/1064] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:40 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:41.714429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:41.716228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:41.721388 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:41.721871 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:41.722305 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:41.722994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:41.723442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:41.723868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:41.855123 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:41.863531 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:41.864981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:41.866177 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-99de7707-1e63-437b-9b56-7e8788ab1d7d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.155818 Oct 27 01:37:41.866733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 540/1065] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:41 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:42.891667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:42.892276 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:42.899254 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:42.899728 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:42.900160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:42.900846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:42.901331 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:42.901756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:43.033548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:43.042190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:43.043666 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:43.044822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-9bd7fc2a-862b-4fb1-8dd1-a3180f688e9d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.157048 Oct 27 01:37:43.045425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 526/1066] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:42 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:44.071338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:44.071868 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:44.078281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:44.078760 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:44.079300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:44.080036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:44.080500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:44.080933 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:44.207870 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:44.216896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:44.218361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:44.219515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-eea5fa3f-4a23-4e9b-9427-aa56aec7e854 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.152686 Oct 27 01:37:44.220065 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 541/1067] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:44 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:45.245348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:45.245953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:45.252407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:45.252895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:45.253356 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:45.254050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:45.254499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:45.254920 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:45.386429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:45.394432 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:45.395861 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:45.396999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-35aeb8da-720a-48e6-a282-229132220bc5 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.155858 Oct 27 01:37:45.397578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 527/1068] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:45 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:46.422865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:46.423479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:46.425652 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=25 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:46.431521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:46.432006 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:46.432444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:46.433173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:46.433624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:46.434052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:46.436548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:46.562296 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:46.570480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:46.571962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:46.573158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-17609fcc-d5e5-403b-8f02-71b25a0b59fa tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1743 microversion: 2.20 time: 0.154249 Oct 27 01:37:46.573723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 542/1069] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:46 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:47.599308 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:47.599900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:47.602845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=25 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:47.608408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:47.608917 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:47.609379 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:47.610065 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:47.610513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:47.610930 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:47.613713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:37:47.746656 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:47.754608 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:47.756040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:47.757220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4684fb92-a48e-4f23-8977-d9cc66847ee9 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1743 microversion: 2.20 time: 0.161859 Oct 27 01:37:47.757831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 528/1070] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:47 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:48.782772 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:48.783380 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:48.790678 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:48.791160 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:48.791596 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:48.792283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:48.792733 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:48.793188 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:48.921209 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:48.929447 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:48.931539 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:48.932689 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8128b5b2-ae31-4fa1-b98e-a0c36a8a221b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1743 microversion: 2.20 time: 0.153858 Oct 27 01:37:48.933275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 543/1071] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:48 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:49.958821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:49.959423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:49.966137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:49.966622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:49.967052 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:49.967725 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:49.968175 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:49.968595 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:50.095140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:50.103134 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:50.104682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:50.105856 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f2ad31a5-a21f-4b5e-88e1-d79e8bf58c4f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1743 microversion: 2.20 time: 0.151133 Oct 27 01:37:50.106402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 529/1072] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:49 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:50.371630 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "name": "network-vif-plugged", "status": "completed", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:37:50.382700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:50.383914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:50.384352 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:50.395343 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] Creating event network-vif-plugged:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:37:50.400501 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-fc2901ed-36de-43fc-9bbb-7c4415b559c0 req-234fd1e9-5e9c-4847-b632-5bfdd066443b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032924 Oct 27 01:37:50.401020 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 544/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:37:51.131123 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:51.131859 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:51.139215 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:51.139719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:51.140151 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:51.140845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:51.141313 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:51.141735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:51.277157 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:51.285085 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:51.286512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:51.287648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3f8fa0e9-c6db-4de2-8701-3d0de7c2d102 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.160390 Oct 27 01:37:51.288192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 530/1074] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:51 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:52.317172 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:52.318605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:52.327117 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:52.327947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:52.328714 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:52.329921 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:52.330661 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:52.331185 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:52.491400 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:52.500363 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:52.501955 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:52.503336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c022f36b-5e1a-4a94-8e3d-ad6ce51fba96 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.190717 Oct 27 01:37:52.504199 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 545/1075] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:52 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:53.533899 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:53.534548 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:53.541883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:53.542680 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:53.544152 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:53.545689 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:53.546646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:53.547156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:53.716635 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:53.725199 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:53.728970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:53.731530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-01051071-02da-480d-ac92-fb19c3a9a84a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.202960 Oct 27 01:37:53.732764 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 531/1076] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:53 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:54.761464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:54.762094 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:54.772099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:54.772900 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:54.774747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:54.774907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:54.775349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:54.775779 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:54.921602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:54.934399 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:54.937272 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:54.938483 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8d1e6c08-cb8a-466d-b521-897a8fc344a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.181791 Oct 27 01:37:54.939231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 546/1077] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:54 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:55.969658 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:55.971019 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:55.978349 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:55.979047 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:55.979665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:55.984500 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:55.985435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:55.985897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:56.137858 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:56.147694 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:56.149672 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:56.151100 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-35a79905-d97f-4f30-8049-ca50f0c5a354 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.186403 Oct 27 01:37:56.165257 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 532/1078] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:55 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:57.181360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:57.182097 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:57.189886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:57.189886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:57.189886 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:57.190667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:57.191194 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:57.191804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:57.354049 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:57.363096 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:57.364288 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:57.365502 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0b6da33e-be08-412d-8560-fba37e2fbc73 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.189628 Oct 27 01:37:57.366060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 547/1079] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:57 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:58.395012 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:58.395812 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:58.406369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:58.407166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:58.407957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:58.408972 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:58.409990 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:58.410424 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:58.568501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:58.577841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:58.580578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:58.580578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f48bbf40-4d2d-4e97-b1c4-596d1fa48b59 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.192455 Oct 27 01:37:58.581369 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 533/1080] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:58 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:37:59.610981 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:37:59.611589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:37:59.619599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:59.620583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:59.621037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:59.621941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:37:59.622279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:37:59.622726 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:37:59.767878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:59.777575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:59.779433 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:37:59.780801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-dbe211fc-6c45-4978-b56f-fca26193c844 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.174011 Oct 27 01:37:59.781454 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 548/1081] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:37:59 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:00.809335 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:00.810013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:00.816433 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:00.816905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:00.817365 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:00.818051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:00.818495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:00.818914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:00.946870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:00.954659 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:00.956089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:00.957266 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a6846447-99b5-4609-8006-eda42340d882 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1738 microversion: 2.20 time: 0.153177 Oct 27 01:38:00.957818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 534/1082] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:00 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:01.983352 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:01.983948 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:01.990185 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:01.990660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:01.991087 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:01.991788 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:01.992214 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:01.992636 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:02.121339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:02.129353 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:02.130777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:02.131941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a4267927-e1c9-4898-aacc-4d43dac8e3e3 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1720 microversion: 2.20 time: 0.152512 Oct 27 01:38:02.132480 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 549/1083] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:01 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:03.157440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:03.157977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:03.165480 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:03.165964 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:03.166396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:03.167078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:03.167524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:03.167941 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:03.300230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:03.309471 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:03.310953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:03.312106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-07867aeb-1887-4a0e-83d5-85046c87389d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1720 microversion: 2.20 time: 0.158649 Oct 27 01:38:03.312668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 535/1084] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:03 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:04.340007 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:04.340612 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:04.347016 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.347497 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.347929 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.348615 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.349076 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.349499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.392353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "name": "network-vif-unplugged", "status": "completed", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:04.403914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.404405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.404828 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.416934 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.compute.server_external_events [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] Unable to find a host for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25. Dropping event network-vif-unplugged {{(pid=118905) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 01:38:04.417850 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-1ce1aca8-da4f-4dcc-bb66-5cc3a35a95f3 req-b1e12b39-7c64-4d83-9973-f9fb0ccd7cc8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029378 Oct 27 01:38:04.418616 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 536/1085] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 01:38:04.483517 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:04.491572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:04.493708 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:04.494991 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2cdff4f3-d3b7-4a3e-b520-2da09348d06b tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1663 microversion: 2.20 time: 0.160097 Oct 27 01:38:04.495556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 550/1086] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:04 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:04.521498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d065550-912f-48b3-879e-fe4ace76b5c9"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:04.523791 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:04.529758 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.530243 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.530682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.531368 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.531821 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.532250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.808172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-242e6ff4-f585-4d97-9e58-c90c77e209b7 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290636 Oct 27 01:38:04.808771 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 537/1087] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Oct 27 01:38:04 2022] POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 01:38:04.934648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:04.935145 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:04.941113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.941582 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.942015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:04.942698 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:04.943150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:04.943572 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:05.177220 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9ebf62d3-bb1d-42dc-bd92-80f541ce6184 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments/1d065550-912f-48b3-879e-fe4ace76b5c9" status: 202 len: 0 microversion: 2.20 time: 0.246965 Oct 27 01:38:05.177796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 551/1088] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Oct 27 01:38:04 2022] DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments/1d065550-912f-48b3-879e-fe4ace76b5c9 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:38:05.240773 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:05.241425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:05.248059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:05.248563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:05.248981 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:05.249695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:05.250146 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:05.250568 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:05.279065 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118905) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 01:38:05.343249 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a249cd8c-e635-4185-9913-7ad3e868c830 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/action" status: 202 len: 0 microversion: 2.20 time: 0.106407 Oct 27 01:38:05.343842 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 538/1089] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Oct 27 01:38:05 2022] POST /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:38:05.351910 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:05.353735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:05.360825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:05.361330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:05.361767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:05.362459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:05.362901 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:05.363321 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:05.500311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:05.509201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:05.510796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:05.512011 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a47e8e16-cc4e-4e47-9c2f-33550235df14 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1671 microversion: 2.20 time: 0.163926 Oct 27 01:38:05.512648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 552/1090] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:05 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:06.539000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:06.539543 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:06.545660 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:06.546142 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:06.546578 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:06.547314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:06.547770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:06.548190 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:06.685491 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:06.693439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:06.694870 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:06.696670 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-59f41562-18a2-48f6-a4eb-31dd87ebc642 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1673 microversion: 2.20 time: 0.161610 Oct 27 01:38:06.697396 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 539/1091] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:06 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:07.723093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:07.723722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:07.730370 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:07.730854 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:07.731300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:07.732000 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:07.732455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:07.732888 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:07.871381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:07.894406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:07.895889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:07.897142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-89095258-fc1e-44e5-b5c5-f633143c96ef tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.177890 Oct 27 01:38:07.897723 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 553/1092] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:07 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:08.923508 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:08.924115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:08.932252 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:08.932788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:08.933310 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:08.936577 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:08.937050 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:08.937513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:09.074822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:09.083160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:09.084576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:09.085761 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c9bd1ed7-058e-498a-85df-e191bc33fe9e tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.166376 Oct 27 01:38:09.086320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 540/1093] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:08 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:10.113663 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:10.114279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:10.121864 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:10.122347 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:10.122776 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:10.123633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:10.124093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:10.124520 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:10.266017 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:10.275809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:10.277278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:10.278458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f47a009c-959b-4d61-8e0e-71e9690e8d45 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.169008 Oct 27 01:38:10.290438 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 554/1094] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:10 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:11.307095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:11.307744 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:11.314467 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:11.315180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:11.315416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:11.316095 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:11.316538 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:11.316961 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:11.457205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:11.459469 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:11.467067 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:11.468501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:11.469714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4ec8ed1f-579e-41c5-8287-756bfca8ec4c tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.167383 Oct 27 01:38:11.470623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 541/1095] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:11 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:12.496145 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:12.496770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:12.503312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:12.503796 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:12.504233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:12.504936 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:12.505415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:12.505842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:12.657878 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:12.666475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:12.668194 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:12.669606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4d2240d2-3e2f-4e5d-b112-2f0cfd3c3537 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.177636 Oct 27 01:38:12.680688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 555/1096] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:12 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:13.697115 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:13.698462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:13.706218 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:13.706698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:13.707133 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:13.707822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:13.708261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:13.708674 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:13.859788 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:13.868393 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:13.870015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:13.871279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4099274b-852a-4b15-96d1-11b0f5f9f07d tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.179406 Oct 27 01:38:13.871928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 542/1097] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:13 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:14.897919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:14.898538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:14.904849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:14.905360 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:14.905797 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:14.906504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:14.906956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:14.907379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:15.052906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:15.056997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:15.063281 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:15.064730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:15.065999 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a692a2d2-5d3e-47b3-82c0-ca3605bc287a tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.172151 Oct 27 01:38:15.066705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 556/1098] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:14 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:16.091826 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:16.092397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:16.098545 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:16.099013 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:16.099439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:16.100112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:16.100555 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:16.100970 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:16.238893 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:16.248000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:16.249479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:16.250636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f182d5e6-2541-4bc3-bf82-489f67b58555 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.162765 Oct 27 01:38:16.251191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 543/1099] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:16 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:17.276403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:17.277013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:17.279767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=30 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:17.285883 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:17.286365 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:17.286800 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:17.287496 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:17.287947 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:17.288372 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:17.414806 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:17.422804 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:17.424232 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:17.425408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1a52f01a-b015-45f6-ba5c-a2abb075d6cc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.152970 Oct 27 01:38:17.425964 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 557/1100] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:17 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:18.451887 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:18.452530 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:18.454896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:38:18.460756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:18.461278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:18.461716 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:18.462544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:18.462983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:18.463407 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:18.590606 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:18.598958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:18.600390 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:18.601561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8f2f1c35-6157-41de-9749-4b772e2c6b34 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.153598 Oct 27 01:38:18.602112 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 544/1101] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:18 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:38:19.627589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:19.628196 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:19.634694 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:19.635169 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:19.635602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:19.636289 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:19.636736 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:19.637189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:19.767924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:19.776604 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:19.778072 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:19.779230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-30e03db2-cb6a-47ee-abf4-7f0267e40590 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.155588 Oct 27 01:38:19.779791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 558/1102] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:19 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:20.806070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:20.806699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:20.813227 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:20.813710 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:20.814141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:20.814827 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:20.815274 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:20.815912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:20.942465 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:20.950853 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:20.952295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:20.953472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-45f13e27-35ca-4e63-920d-fc2fc1ca6379 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.151833 Oct 27 01:38:20.954027 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 545/1103] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:20 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:21.979830 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:21.980462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:21.987104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:21.987586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:21.988021 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:21.988722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:21.989513 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:21.989954 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:22.145743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:22.153899 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:22.155415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:22.156583 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8afd0be4-9c8f-464d-b57d-6d30bd1420f2 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.180933 Oct 27 01:38:22.157159 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 559/1104] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:21 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:23.183780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:23.184363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:23.190789 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:23.191266 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:23.191701 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:23.192383 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:23.192831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:23.193299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:23.319803 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:23.328457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:23.329927 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:23.331081 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c836d4ef-feb4-4413-9c58-c5fb8ab96adc tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.152289 Oct 27 01:38:23.331636 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 546/1105] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:23 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:24.357629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:24.358236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:24.364639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:24.365215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:24.365653 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:24.366343 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:24.366791 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:24.367223 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:24.497276 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:24.505656 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:24.506962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:24.508168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fa4eeee8-ac30-4989-b817-b65fcdc67923 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.155222 Oct 27 01:38:24.508732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 560/1106] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:24 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:38:24.596464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "name": "network-vif-plugged", "status": "completed", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:24.607435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:24.608048 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:24.608297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:24.619733 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] Creating event network-vif-plugged:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:38:24.624943 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-42aa514a-15bc-4d57-864f-303fba6e9bb7 req-9b28c461-15a9-4332-8aa8-64744f1914df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Oct 27 01:38:24.625782 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 547/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:38:25.534880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:25.535462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:25.541956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:25.542429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:25.542855 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:25.543542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:25.543984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:25.544404 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:25.670709 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:25.678973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:25.680411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:25.682142 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-9051cc2c-2dc1-4b77-a949-30c95513cd51 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.151154 Oct 27 01:38:25.682701 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 561/1108] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:25 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:26.707729 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:26.708525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:26.714847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:26.715326 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:26.715753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:26.716435 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:26.716882 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:26.717320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:26.861692 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:26.870655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:26.872189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:26.873405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fb25d021-2fe8-48c9-8132-69bc977f2c94 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1729 microversion: 2.20 time: 0.170303 Oct 27 01:38:26.873966 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 548/1109] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:26 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:27.900519 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:27.901266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:27.909667 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:27.910151 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:27.910581 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:27.913730 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:27.916154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:27.916597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:28.066338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:28.075401 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:28.076840 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:28.078036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a30f6b8f-8cb0-484a-97f9-cf0c16530c87 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1716 microversion: 2.20 time: 0.182735 Oct 27 01:38:28.078602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 562/1110] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:38:27 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1716 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:38:32.246705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1539203924"}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:32.247238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:32.253731 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:32.254207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:32.254637 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:32.255319 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:32.255765 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:32.256184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:32.385650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.network.security_group_api [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Removing security group 1670db2e-3851-4042-bc05-508ead4b005e from port f8228812-5eef-44c7-8163-dcef9ae06091 Oct 27 01:38:32.681884 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5cb9a564-4917-44a7-9625-ff788d39f678 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action" status: 202 len: 0 microversion: 2.1 time: 0.439631 Oct 27 01:38:32.682525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 549/1111] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Oct 27 01:38:32 2022] POST /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:38:32.690234 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:32.701552 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:32.702116 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:32.702616 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:32.715436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] Creating event network-changed:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:38:32.721245 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-ff179662-77c7-49f8-a26f-5ffe0a328390 req-c4320196-7882-4dee-aa56-66b686da01e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034808 Oct 27 01:38:32.722154 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 563/1112] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:38:33.728790 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:33.729955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:33.730617 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:33.737088 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:33.737700 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:33.738241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:33.739073 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:33.739626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:33.740156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:33.741047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:33.741555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:33.742079 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:33.753649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] Creating event network-changed:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:38:33.758512 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-a4a85b75-4940-49d9-be56-2c2209faba49 req-ed34fd70-6df6-4cfd-bb98-74a060b8f961 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032644 Oct 27 01:38:33.759291 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 564/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:38:33.831625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lazy-loading 'services' on Instance uuid ddbc362d-5688-423d-ba41-10c8513e2512 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:38:33.911723 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-a8180a97-db57-4fd0-bf1c-80aef8b63aa0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments/600d5c7d-3c9a-429d-ae06-5a05cd3ff01b" status: 202 len: 0 microversion: 2.1 time: 0.188089 Oct 27 01:38:33.912449 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 550/1114] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:38:33 2022] DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments/600d5c7d-3c9a-429d-ae06-5a05cd3ff01b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:38:33.923665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:33.926349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:33.936261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:33.936962 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:33.937465 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:33.938338 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:33.939575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:33.940091 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:33.973446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1e005688-c446-49b8-ac89-915481fc2042 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054184 Oct 27 01:38:33.974112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 565/1115] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:38:33 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:38:34.988515 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:34.990860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:34.997772 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:34.998251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:34.998687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:34.999375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:34.999825 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:35.000250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:35.028397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-3a3e85ff-25dc-43ba-9401-5a3ee792e189 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044750 Oct 27 01:38:35.028947 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 551/1116] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Oct 27 01:38:34 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 01:38:35.039803 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:35.041150 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:35.047396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:35.047880 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:35.048322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:35.049013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:35.049503 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:35.049934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:35.123978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] HTTP exception thrown: Instance ddbc362d-5688-423d-ba41-10c8513e2512 is not attached to volume 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Request method failure captured: Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments/600d5c7d-3c9a-429d-ae06-5a05cd3ff01b HTTP/1.1 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeAoQRr41wXJ3THS3aINSZYTdvr-wrRkw0OoGVbM-K4b5Zxf2CXG1UTXPLqIVsO4zecirVPPoS3XMpKVI08rE3kl9RGa41atL85FH73m_ApPo0wDVZmhZSEDbWFnqCBYssE4pyTh7NWMuXyEltpojQdSJzNP-kvR3WSWYmyNxU3OjUY Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 9e496297038149beb8bfe69c53234988 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:38:35.126349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e496297038149beb8bfe69c53234988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e496297038149beb8bfe69c53234988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e496297038149beb8bfe69c53234988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e496297038149beb8bfe69c53234988", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 9e496297038149beb8bfe69c53234988 Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-TestMinimumBasicScenario-1979442178-project Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: e1ff3076fbb342caaf7d617c079a9080 Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-TestMinimumBasicScenario-1979442178-project Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:38:35.128057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance ddbc362d-5688-423d-ba41-10c8513e2512 is not attached to volume 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'server_id': 'ddbc362d-5688-423d-ba41-10c8513e2512', 'id': '600d5c7d-3c9a-429d-ae06-5a05cd3ff01b'} Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b. Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:38:35.129099 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbc362d-5688-423d-ba41-10c8513e2512 is not attached to volume 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbc362d-5688-423d-ba41-10c8513e2512 is not attached to volume 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:35.130633 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Returning 404 to user: Instance ddbc362d-5688-423d-ba41-10c8513e2512 is not attached to volume 600d5c7d-3c9a-429d-ae06-5a05cd3ff01b {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:38:35.131896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0280cf91-16e1-410a-add3-40bfacd046d0 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments/600d5c7d-3c9a-429d-ae06-5a05cd3ff01b" status: 404 len: 154 microversion: 2.1 time: 0.091999 Oct 27 01:38:35.131896 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 566/1117] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Oct 27 01:38:35 2022] DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512/os-volume_attachments/600d5c7d-3c9a-429d-ae06-5a05cd3ff01b => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 01:38:36.268096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:36.268571 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:36.275229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:36.275714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:36.276147 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:36.276831 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:36.277314 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:36.277735 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:36.301322 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:38:36.375991 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-eea8441d-e0e3-40d0-9399-2986d1f07c2d tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 204 len: 0 microversion: 2.1 time: 0.111513 Oct 27 01:38:36.376564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 552/1118] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:38:36 2022] DELETE /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:38:36.385124 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:36.385643 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:36.394121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:36.394894 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:36.395434 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:36.396279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:36.396826 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:36.397598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:36.528121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:36.535770 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-28b6b2ee-d60e-46de-b434-1390c074b3ef tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1553 microversion: 2.1 time: 0.154821 Oct 27 01:38:36.536322 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 567/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:38:36 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:38:37.560819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:37.561574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:37.567885 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:37.568361 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:37.568795 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:37.569527 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:37.569974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:37.570394 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:37.700743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:37.708324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-aed66139-f0eb-4f90-bd21-5f9a89fa3aba tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1553 microversion: 2.1 time: 0.152447 Oct 27 01:38:37.708886 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 553/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:38:37 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:38:38.731844 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:38.732452 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:38.738784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:38.739261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:38.739687 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:38.740377 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:38.740821 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:38.741271 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:38.924905 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ff3076fbb342caaf7d617c079a9080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e496297038149beb8bfe69c53234988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:38:38.933755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1b49c240-ebe2-4f74-9cd6-f737ee58acb1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 200 len: 1553 microversion: 2.1 time: 0.205837 Oct 27 01:38:38.934359 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 568/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:38:38 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:38:39.036182 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbc362d-5688-423d-ba41-10c8513e2512", "name": "network-vif-deleted", "tag": "f8228812-5eef-44c7-8163-dcef9ae06091"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:38:39.046536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:39.047008 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:39.047434 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:39.059232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] Creating event network-vif-deleted:f8228812-5eef-44c7-8163-dcef9ae06091 for instance ddbc362d-5688-423d-ba41-10c8513e2512 on hv-cinder-81558 Oct 27 01:38:39.064195 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-03fa5b24-832a-415a-a50b-e3b3b3b4f7f3 req-ae55e99c-9327-467c-a9e7-f5f2336dba1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031616 Oct 27 01:38:39.064796 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 554/1122] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:38:39.958108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:39.958710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [instance: ddbc362d-5688-423d-ba41-10c8513e2512] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:38:39.966135 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:39.966602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:39.967028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:39.967705 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:38:39.968144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:38:39.968559 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:38:39.982995 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] HTTP exception thrown: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Request method failure captured: Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 HTTP/1.1 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeAoQRr41wXJ3THS3aINSZYTdvr-wrRkw0OoGVbM-K4b5Zxf2CXG1UTXPLqIVsO4zecirVPPoS3XMpKVI08rE3kl9RGa41atL85FH73m_ApPo0wDVZmhZSEDbWFnqCBYssE4pyTh7NWMuXyEltpojQdSJzNP-kvR3WSWYmyNxU3OjUY Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 9e496297038149beb8bfe69c53234988 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:38:39.984498 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e496297038149beb8bfe69c53234988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e496297038149beb8bfe69c53234988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e496297038149beb8bfe69c53234988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e496297038149beb8bfe69c53234988", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 9e496297038149beb8bfe69c53234988 Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1979442178 Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-TestMinimumBasicScenario-1979442178-project Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: e1ff3076fbb342caaf7d617c079a9080 Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-TestMinimumBasicScenario-1979442178-project Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. Oct 27 01:38:39.986163 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'ddbc362d-5688-423d-ba41-10c8513e2512'} Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:38:39.987055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. Oct 27 01:38:39.988655 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:38:39.990386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Returning 404 to user: Instance ddbc362d-5688-423d-ba41-10c8513e2512 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:38:39.990386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4fef4a2a-5e95-47ff-bed1-e5b82a9d14c1 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512" status: 404 len: 111 microversion: 2.1 time: 0.031651 Oct 27 01:38:39.990386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 569/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:38:39 2022] GET /compute/v2.1/servers/ddbc362d-5688-423d-ba41-10c8513e2512 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:38:39.995137 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-12f1ea89-d815-4a7e-8ba0-17443b0bc0d2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] Calling method '.version_select at 0x7f6c12fee5e0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:38:39.999499 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12f1ea89-d815-4a7e-8ba0-17443b0bc0d2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [47bb635d-22dc-4ba7-a138-52ba85b90fe4] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 01:38:41.007089 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [None req-12f1ea89-d815-4a7e-8ba0-17443b0bc0d2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] [47bb635d-22dc-4ba7-a138-52ba85b90fe4] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 58726. Oct 27 01:38:41.025552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-12f1ea89-d815-4a7e-8ba0-17443b0bc0d2 tempest-TestMinimumBasicScenario-1979442178 tempest-TestMinimumBasicScenario-1979442178-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-302479538" status: 202 len: 0 microversion: 2.1 time: 1.034571 Oct 27 01:38:41.026171 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 555/1124] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Oct 27 01:38:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-302479538 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:39:23.453525 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:23.455682 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:23.458036 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=25 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:39:23.458677 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=66 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:39:23.459563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:39:23.459744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments (ip 10.222.0.42) !!! Oct 27 01:39:23.461914 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:39:23.462045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments (ip 10.222.0.42) !!! Oct 27 01:39:23.480765 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.481273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.482286 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:23.483131 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.483589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.484014 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:23.512889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6a4ad3dd-8bf6-40f6-99fc-aa5bbaa6a9cd tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064518 Oct 27 01:39:23.513459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 570/1125] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Oct 27 01:39:23 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:39:23.573414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:39:23.574148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:39:23.579641 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:23.580786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:23.589305 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.589780 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.590209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:23.590888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.591484 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.591906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:23.618429 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:39:23.695022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-68a31461-1407-443a-8618-dc01b5207a53 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 204 len: 0 microversion: 2.20 time: 0.122530 Oct 27 01:39:23.695682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 556/1126] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 01:39:23 2022] DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:39:23.705416 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:23.706102 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:23.711913 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.712387 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.712814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:23.713537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:23.713983 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:23.714405 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:24.047634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:24.055799 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:24.057259 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:24.058407 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a04eae13-3eda-4725-b613-94ac2d15e738 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.357733 Oct 27 01:39:24.058959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 571/1127] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:23 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 01:39:25.084687 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:25.085324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:25.091631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:25.092103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:25.093136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:25.093822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:25.094264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:25.094680 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:25.276823 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:25.285639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:25.287076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:25.288232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-853d768e-129e-47ae-82b3-3ea532ecf3a1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1722 microversion: 2.20 time: 0.207907 Oct 27 01:39:25.288798 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 557/1128] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:25 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:39:26.088129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87b6a2-3f61-46a5-b718-bd37f4f7cf25", "name": "network-vif-deleted", "tag": "11beae3d-d55d-4ac6-a919-1db9f46a0469"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:39:26.111019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:26.111949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:26.112883 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:26.129217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] Creating event network-vif-deleted:11beae3d-d55d-4ac6-a919-1db9f46a0469 for instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 on hv-cinder-81558 Oct 27 01:39:26.134684 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-46ffb378-9262-4e36-a973-f0325930ed79 req-3b56a699-c480-4fde-8fe8-942995991a0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051896 Oct 27 01:39:26.135300 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 572/1129] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:39:26.316512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:26.317246 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:26.323994 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:26.324613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:26.325279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:26.326155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:26.326705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:26.328510 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:26.360883 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:26.361364 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:26.361794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:26.362230 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lazy-loading 'fault' on Instance uuid 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:39:26.403978 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:26.413277 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:26.414717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '608f1351ab84402d8634ba99b6e26323', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c30908c04242e28297b339bfcc5600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:39:26.415896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8e8fedb7-a89d-414e-b0a2-079a4b27ec22 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 200 len: 1371 microversion: 2.20 time: 0.104844 Oct 27 01:39:26.423999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 558/1130] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:26 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 01:39:27.443345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:27.444038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:27.450592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:27.451066 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:27.451499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:27.452215 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:27.452877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:27.453330 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:27.466258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 HTTP/1.1 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:39:27.468030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:27.469876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '5f87b6a2-3f61-46a5-b718-bd37f4f7cf25'} Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:27.470819 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:27.472373 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:27.474082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:27.474082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a20fc242-3952-45d9-b69d-929882ea271f tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 404 len: 111 microversion: 2.20 time: 0.030367 Oct 27 01:39:27.474082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 573/1131] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:27 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:39:27.478220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b3a08840-29c3-4bab-aa42-ff3eb3965359 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '.version_select at 0x7f6c13304430>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:27.497645 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b3a08840-29c3-4bab-aa42-ff3eb3965359 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822649507" status: 204 len: 0 microversion: 2.20 time: 0.023249 Oct 27 01:39:27.498200 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 559/1132] 10.222.0.42 () {60 vars in 1262 bytes} [Thu Oct 27 01:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822649507 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 01:39:29.245371 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:29.246176 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:29.256451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:29.257290 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:29.258015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:29.259230 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:29.259732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:29.260173 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:29.277528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 HTTP/1.1 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:39:29.280876 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.282486 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '5f87b6a2-3f61-46a5-b718-bd37f4f7cf25'} Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:29.283236 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.284597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.286047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:29.286047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ae6b3b8e-4fc2-4dbd-979e-d0a619faf858 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 404 len: 111 microversion: 2.20 time: 0.040906 Oct 27 01:39:29.286047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 574/1133] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 01:39:29 2022] DELETE /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:39:29.291459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:29.292103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:29.299070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:29.299562 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:29.299998 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:29.300695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:29.301194 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:29.301625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:29.315988 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 HTTP/1.1 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:39:29.317779 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.319717 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '5f87b6a2-3f61-46a5-b718-bd37f4f7cf25'} Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:29.320607 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. Oct 27 01:39:29.322135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:29.323477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance 5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:29.323477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-611fc47e-8231-4bcf-a508-778bbb0189d1 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25" status: 404 len: 111 microversion: 2.20 time: 0.032205 Oct 27 01:39:29.323477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 560/1134] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:29 2022] GET /compute/v2.1/servers/5f87b6a2-3f61-46a5-b718-bd37f4f7cf25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:39:30.475907 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:30.476440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:30.482744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:30.483242 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:30.483710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:30.484362 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:30.484808 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:30.485261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:30.498406 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f HTTP/1.1 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:39:30.500182 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.501967 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': 'b414d9ca-9bc2-4101-953a-4f866cf4326f'} Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:30.502867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.504341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.505825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:30.505825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8229fae8-f53e-4e31-a37a-bdfa4b1645e6 tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 404 len: 111 microversion: 2.20 time: 0.029605 Oct 27 01:39:30.505825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 575/1135] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Oct 27 01:39:30 2022] DELETE /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:39:30.510074 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:30.510683 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] [instance: b414d9ca-9bc2-4101-953a-4f866cf4326f] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:39:30.517817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:30.518320 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:30.518951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:30.519566 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:39:30.520033 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:39:30.520513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:39:30.534370 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] HTTP exception thrown: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Request method failure captured: Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f HTTP/1.1 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWd9WSgUdYCfpSUuWDcQ3T8nqkXWUo0QL8Zd52_yULdvclBpPama7XQAnsIa3SeVW5W2f6Y4eck59G5-WOcK0mNKRUlkz8FFFTcpxdJp1EF5clsoiEQxO2trPA2g6VbMvzmHNxGnJnPRzgR-iaI2BVhvICpElT4y_5wy6cheJfhodazk Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:39:30.535891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/73c30908c04242e28297b339bfcc5600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/73c30908c04242e28297b339bfcc5600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_73c30908c04242e28297b339bfcc5600", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 73c30908c04242e28297b339bfcc5600 Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-350841052 Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: 608f1351ab84402d8634ba99b6e26323 Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-AttachVolumeShelveTestJSON-350841052-project Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.537651 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': 'b414d9ca-9bc2-4101-953a-4f866cf4326f'} Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:30.538439 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. Oct 27 01:39:30.539684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:39:30.540792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] Returning 404 to user: Instance b414d9ca-9bc2-4101-953a-4f866cf4326f could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:30.540792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-dffb19ac-37d3-4647-bdba-a94183f97cbe tempest-AttachVolumeShelveTestJSON-350841052 tempest-AttachVolumeShelveTestJSON-350841052-project] 10.222.0.42 "GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f" status: 404 len: 111 microversion: 2.20 time: 0.031035 Oct 27 01:39:30.540792 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 561/1136] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Oct 27 01:39:30 2022] GET /compute/v2.1/servers/b414d9ca-9bc2-4101-953a-4f866cf4326f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 01:39:34.622140 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-fccccdc2-711e-404d-8da6-ab3d9ce0017f tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Action: 'create', calling method: .version_select at 0x7f6c12f5d310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-799208113", "metadata": {"Type": "work"}}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:39:34.904301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-fccccdc2-711e-404d-8da6-ab3d9ce0017f tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.396019 Oct 27 01:39:34.904939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 576/1137] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Oct 27 01:39:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 397 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 01:39:34.918103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-63c18992-3a0b-4078-8a01-a6345b5d8413 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c13304310>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:34.970204 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-63c18992-3a0b-4078-8a01-a6345b5d8413 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 200 len: 352 microversion: 2.1 time: 0.055819 Oct 27 01:39:34.970776 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 562/1138] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:39:34 2022] GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:39:35.985560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-cc380b60-816c-4c70-a722-f0b116c669e7 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c12f2faf0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:36.032660 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-cc380b60-816c-4c70-a722-f0b116c669e7 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 200 len: 353 microversion: 2.1 time: 0.051944 Oct 27 01:39:36.033273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 577/1139] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:39:35 2022] GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:39:36.046563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-00c7c944-e7f7-4eb4-ac75-6e80c51944e0 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c12f3ef70>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:36.093203 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-00c7c944-e7f7-4eb4-ac75-6e80c51944e0 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 200 len: 353 microversion: 2.1 time: 0.050828 Oct 27 01:39:36.093762 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 563/1140] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:39:36 2022] GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:39:36.111233 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-aba7f982-8e41-46e3-a2a9-c1d15d0ce969 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c12ead940>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:36.171732 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-aba7f982-8e41-46e3-a2a9-c1d15d0ce969 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 202 len: 0 microversion: 2.1 time: 0.064273 Oct 27 01:39:36.172870 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 578/1141] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Oct 27 01:39:36 2022] DELETE /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 01:39:36.180984 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fe5a1aef-d14d-4fc7-a092-357cf4639299 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c130e9ee0>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:36.229736 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fe5a1aef-d14d-4fc7-a092-357cf4639299 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 200 len: 352 microversion: 2.1 time: 0.053038 Oct 27 01:39:36.232905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 564/1142] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:39:36 2022] GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:39:37.245700 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5becd26a-1735-4cca-809e-f9c440275667 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Calling method '.version_select at 0x7f6c133834c0>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:39:37.273396 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-5becd26a-1735-4cca-809e-f9c440275667 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] HTTP exception thrown: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5becd26a-1735-4cca-809e-f9c440275667 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Request method failure captured: Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a HTTP/1.1 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeFWDvAmv5p3dRg-mmv9iECqHkHkmBNrG35GWQNlym7lsKWwzMDnLwNmVUeDw0Mz2twmwuuJ6WYLG0zuXyLGSioMky5vqgitHnFz4ca-KVPFx7Zop76K7a2BTjkYTjAyrIbrS4F-lGICSQjIXiraZx3Gwdi3DlShfjnOJj699AsBoXo Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 6f14e0b4a1ec4e9fa4c4f4355f5fa328 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-VolumesGetTestJSON-1345633054 Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:39:37.275317 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6f14e0b4a1ec4e9fa4c4f4355f5fa328"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f14e0b4a1ec4e9fa4c4f4355f5fa328"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6f14e0b4a1ec4e9fa4c4f4355f5fa328"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6f14e0b4a1ec4e9fa4c4f4355f5fa328", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-VolumesGetTestJSON-1345633054 Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 6f14e0b4a1ec4e9fa4c4f4355f5fa328 Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-VolumesGetTestJSON-1345633054 Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-VolumesGetTestJSON-1345633054-project Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: 176e48763d6447c6ba6afcfc1705f1dc Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-VolumesGetTestJSON-1345633054-project Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '659f580f-78fc-4590-8015-4832f948cd7a'} Oct 27 01:39:37.276975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. (HTTP 404) (Request-ID: req-9d5574d7-7ff6-4c27-8a39-b64a0c7afb1e) Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:37.278032 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 01:39:37.279495 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 01:39:37.281556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-5becd26a-1735-4cca-809e-f9c440275667 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] Returning 404 to user: Volume 659f580f-78fc-4590-8015-4832f948cd7a could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-5becd26a-1735-4cca-809e-f9c440275667 tempest-VolumesGetTestJSON-1345633054 tempest-VolumesGetTestJSON-1345633054-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a" status: 404 len: 109 microversion: 2.1 time: 0.035402 Oct 27 01:39:37.282978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 579/1143] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Oct 27 01:39:37 2022] GET /compute/v2.1/os-volumes/659f580f-78fc-4590-8015-4832f948cd7a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:40:53.484070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:40:53.485599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:40:53.666016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-5350019b-d836-46aa-bc2e-0e76b5502d4f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Action: 'create', calling method: .version_select at 0x7f6c13304c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1533663802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEDwHmVIpU3mDBh9S99f7c6x/cDuXPNyJGbLyhuuFCg7s+LqPxTWACZs7hCOZCAfIDEs/50/IRXsKxONErhO1CmJ5RW2n2P5f9eVB8hTGQNdwb+llvB3R5kVgzUVYV2yQ=="}} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:40:53.682523 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-5350019b-d836-46aa-bc2e-0e76b5502d4f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:40:53.686847 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.quota [None req-5350019b-d836-46aa-bc2e-0e76b5502d4f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for user ed6abf3b558c44f692e3fc95749642a3 and project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'key_pairs'} {{(pid=118905) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:40:53.712189 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-5350019b-d836-46aa-bc2e-0e76b5502d4f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.230624 Oct 27 01:40:53.712794 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 565/1144] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Oct 27 01:40:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:41:14.261846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=12 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:14.262586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=20 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:14.269144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-125002989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1533663802", "security_groups": [{"name": "tempest-secgroup-smoke-1446069843"}], "block_device_mapping_v2": [{"uuid": "d3b8da70-3865-4caf-be9d-8d61a862209f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ddef7af7-3a37-424a-bbe6-e1306854800a"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:41:14.381433 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] validate_networks() for [('ddef7af7-3a37-424a-bbe6-e1306854800a', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:41:14.845550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:41:14.845978 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:41:14.846481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:41:14.846892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:41:14.847332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:41:14.856073 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:14.856553 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:14.856992 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:14.857758 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:14.858228 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:14.859464 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:14.882429 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:41:14.886584 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for user ed6abf3b558c44f692e3fc95749642a3 and project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:41:14.943481 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:41:14.945624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3b8da70-3865-4caf-be9d-8d61a862209f',volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:41:15.074329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-60588728-bc8d-49fc-ad8f-abfecb31a3c7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815160 Oct 27 01:41:15.074982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 580/1145] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:41:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:41:15.084017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:41:15.084542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Thu Oct 27 01:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b (ip 10.222.0.42) !!! Oct 27 01:41:15.086261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:15.087005 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:15.095458 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6eaabb96-d701-43fe-9ced-3229b9864368 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:15.096071 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6eaabb96-d701-43fe-9ced-3229b9864368 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:15.154103 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6eaabb96-d701-43fe-9ced-3229b9864368 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:15.161534 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6eaabb96-d701-43fe-9ced-3229b9864368 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1094 microversion: 2.1 time: 0.079089 Oct 27 01:41:15.162090 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 566/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:15 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:16.185711 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:16.186349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:16.194550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:16.195420 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:16.195956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:16.196898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:16.197384 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:16.197816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:16.303193 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:16.311475 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-05417ec8-3ed2-4a54-aa19-35f60b895579 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1200 microversion: 2.1 time: 0.131535 Oct 27 01:41:16.312659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 581/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:16 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:17.335205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:17.335914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:17.342316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:17.343172 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:17.343464 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:17.344245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:17.344690 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:17.345134 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:17.582337 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:17.589903 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-6b269c65-f8a2-4b69-8a30-fe7723640633 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.258513 Oct 27 01:41:17.590470 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 567/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:17 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:17.856761 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1bfbf2-3463-4c29-a605-33386eb85a9b", "tag": "11dfa4fd-0bd8-47f5-ba36-b1316a659b83"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:41:17.866541 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:17.867010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:17.867432 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:17.878923 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] Creating event network-changed:11dfa4fd-0bd8-47f5-ba36-b1316a659b83 for instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b on hv-cinder-81558 Oct 27 01:41:17.883784 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-9fff0be5-8ccb-4a06-a20f-20deeb53412b req-2bf131f8-7eb2-415c-80c0-459f187ad05c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104785 Oct 27 01:41:17.884367 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 582/1149] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:41:18.614901 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:18.615536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:18.621495 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:18.622011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:18.622459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:18.623179 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:18.623633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:18.624068 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:18.752525 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:18.760135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c0bbfc66-9044-48c0-9582-86413ebde20a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.149309 Oct 27 01:41:18.760698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 568/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:18 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:41:19.783889 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:19.784589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:19.790841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:19.791323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:19.791760 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:19.792446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:19.792895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:19.793346 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:19.927940 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:19.935875 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f1dd6046-f91c-484c-bb19-954739bc17aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.156737 Oct 27 01:41:19.936436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 583/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:19 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:20.958957 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:20.959591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:20.966180 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:20.966654 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:20.967083 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:20.968290 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:20.969297 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:20.969719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:21.103799 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:21.112076 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e144bd3a-28be-4ee5-a291-3b1a2f16f463 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.157017 Oct 27 01:41:21.112633 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 569/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:20 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:22.135060 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:22.135606 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:22.142084 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:22.142555 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:22.142982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:22.143664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:22.144110 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:22.144524 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:22.541509 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:22.549301 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8e096dec-c71e-4f32-ab76-2cc2c106f9e7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.418218 Oct 27 01:41:22.549862 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 584/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:22 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:41:23.572617 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:23.573232 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:23.580418 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:23.580894 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:23.581355 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:23.582032 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:23.582475 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:23.582889 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:23.712150 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:23.720625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ebd6ba7e-245a-429b-9ad8-b2ef5a0b4997 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.151860 Oct 27 01:41:23.721279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 570/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:23 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:24.743390 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:24.744039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:24.751039 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:24.751519 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:24.751953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:24.752645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:24.753122 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:24.753551 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:24.872504 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:24.886602 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:24.893168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:24.895963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a4245dce-8e9f-4fe7-993d-1b526d885e86 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.156402 Oct 27 01:41:24.896522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 585/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:24 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:25.919064 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:25.919667 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:25.922105 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:41:25.927350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:25.927822 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:25.928251 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:25.928924 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:25.929399 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:25.929817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:26.056459 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:26.064785 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-10738415-e318-4a4e-91a6-54f88a81ba8c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.149523 Oct 27 01:41:26.065375 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 571/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:25 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:27.088777 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:27.089349 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:27.096335 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:27.096809 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:27.097277 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:27.097956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:27.098403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:27.098823 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:27.231270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:27.238801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ae573092-af72-4a76-9107-ec03192d64c1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.154672 Oct 27 01:41:27.239355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 586/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:27 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:28.261158 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:28.261770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:28.268242 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:28.268719 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:28.269258 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:28.269953 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:28.270405 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:28.270829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:28.399551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:28.407615 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-fa094ce7-a437-4859-82be-144d67ab528b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.150512 Oct 27 01:41:28.408184 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 572/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:28 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:29.430744 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:29.431355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:29.438969 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:29.439456 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:29.439890 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:29.440579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:29.441023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:29.441470 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:29.584941 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:29.599710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-420fd810-5748-4b14-aecf-1f3302f2d367 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.172324 Oct 27 01:41:29.600728 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 587/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:29 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:29.672993 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1bfbf2-3463-4c29-a605-33386eb85a9b", "name": "network-vif-plugged", "status": "completed", "tag": "11dfa4fd-0bd8-47f5-ba36-b1316a659b83"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:41:29.682401 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:29.682862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:29.683279 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:29.694565 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] Creating event network-vif-plugged:11dfa4fd-0bd8-47f5-ba36-b1316a659b83 for instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b on hv-cinder-81558 Oct 27 01:41:29.697931 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR oslo.messaging._drivers.impl_rabbit [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] [4fc44763-820b-4726-943f-127facd383ee] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 01:41:30.637045 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:30.637634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:30.645442 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:30.646509 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:30.646747 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:30.647304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:30.647756 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:30.648183 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:30.705016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] [4fc44763-820b-4726-943f-127facd383ee] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59924. Oct 27 01:41:30.708971 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-89612704-4195-4f8e-817d-231195c84486 req-30d2e9eb-50b6-4e79-86e7-620a7cb54356 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.126514 Oct 27 01:41:30.709713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 573/1160] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:41:30.784283 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:30.792168 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-88477fd5-cdc6-4ed1-beb0-3cf3b605544f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.159088 Oct 27 01:41:30.792748 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 588/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:30 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:41:31.817810 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:31.818511 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:31.824714 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:31.825238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:31.825676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:31.826362 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:31.826811 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:31.827233 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:31.964160 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:31.972983 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4f1561c4-e464-41cc-bf2c-29a271e707ac tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1266 microversion: 2.1 time: 0.160601 Oct 27 01:41:31.973600 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 574/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:31 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:32.994817 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:32.995426 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:33.002382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:33.002867 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:33.003331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:33.004026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:33.004479 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:33.004906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:33.132841 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:33.140580 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f5b0e513-ac94-4c31-a329-116b80df5f6f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1452 microversion: 2.1 time: 0.149629 Oct 27 01:41:33.141164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 589/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:32 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:33.162977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:41:33.163591 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:41:33.169996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:33.170477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:33.170906 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:33.171593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:33.172142 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:33.173128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:33.304070 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:41:33.312045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-4e68a805-6fef-4b98-ab0b-80cc862b02fe tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1452 microversion: 2.1 time: 0.152968 Oct 27 01:41:33.312603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 575/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:41:33 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:41:34.902509 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1bfbf2-3463-4c29-a605-33386eb85a9b", "tag": "11dfa4fd-0bd8-47f5-ba36-b1316a659b83"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:41:34.914284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:41:34.914767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:41:34.915199 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:41:34.927794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] Creating event network-changed:11dfa4fd-0bd8-47f5-ba36-b1316a659b83 for instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b on hv-cinder-81558 Oct 27 01:41:34.933425 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-6edb420c-91c8-48ef-921c-25a675fbf223 req-c604cc05-6205-42e4-9df3-88557b7bc304 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034579 Oct 27 01:41:34.934519 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 590/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:43:48.864163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR oslo.messaging._drivers.impl_rabbit [-] [51a2c48d-8d7d-4d3c-b264-c5687fb7366f] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 01:43:48.864815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=22 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:43:48.865471 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=50 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:43:48.866256 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:43:48.866398 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Thu Oct 27 01:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b (ip 10.222.0.42) !!! Oct 27 01:43:48.872330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:48.872818 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:48.880685 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:48.881187 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:48.881620 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:48.882299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:48.882741 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:48.883156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:48.912264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:43:48.985829 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-646c7759-9577-4a73-8511-f3fe37cc7918 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 204 len: 0 microversion: 2.1 time: 0.123404 Oct 27 01:43:48.986642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 576/1166] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:43:48 2022] DELETE /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:43:48.995720 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e8b976-9974-4d8b-8471-f235613bf5ae] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 01:43:48.996323 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:43:48.997164 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=54 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:43:48.998958 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 01:43:48.999132 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b (ip 10.222.0.42) !!! Oct 27 01:43:49.000218 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:43:49.000344 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b (ip 10.222.0.42) !!! Oct 27 01:43:49.007279 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:49.007984 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:49.019743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:49.020225 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:49.020664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:49.021386 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:49.021845 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:49.022261 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:49.154184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:49.161850 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-edfdb6c1-b679-41b9-8c8b-0fb32121bfca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1577 microversion: 2.1 time: 0.168878 Oct 27 01:43:49.162419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 591/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:48 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:43:50.187689 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:50.188397 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:50.201169 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] [51a2c48d-8d7d-4d3c-b264-c5687fb7366f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59982. Oct 27 01:43:50.202554 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:50.203029 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:50.203456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:50.204141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:50.204584 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:50.205004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:50.340268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:50.347898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0df9966a-a02b-4c53-b9e3-7787b98952f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1577 microversion: 2.1 time: 0.165293 Oct 27 01:43:50.348450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 577/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:50 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:51.371599 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:51.372229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:51.379538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:51.380026 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:51.380462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:51.381181 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:51.381629 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:51.382055 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:51.399044 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e8b976-9974-4d8b-8471-f235613bf5ae] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 59986. Oct 27 01:43:51.457450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:51.466112 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-bb30233e-c467-4804-8cb3-24e28c434d71 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1509 microversion: 2.1 time: 0.098621 Oct 27 01:43:51.466904 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 592/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:51 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1509 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:51.634542 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1bfbf2-3463-4c29-a605-33386eb85a9b", "name": "network-vif-deleted", "tag": "11dfa4fd-0bd8-47f5-ba36-b1316a659b83"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:43:51.647724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:51.648302 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:51.649561 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:51.664311 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] Creating event network-vif-deleted:11dfa4fd-0bd8-47f5-ba36-b1316a659b83 for instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b on hv-cinder-81558 Oct 27 01:43:51.671121 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-0468621c-600e-4563-a41c-d739c4b8b084 req-e6db0368-bda8-4025-a9ba-db3395727c0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040462 Oct 27 01:43:51.671950 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 578/1170] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:43:52.489415 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:52.490070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:52.496996 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:52.497527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:52.497963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:52.498693 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:52.499146 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:52.499726 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:52.534106 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:52.534576 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:52.535018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:52.535522 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.objects.instance [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lazy-loading 'fault' on Instance uuid 4c1bfbf2-3463-4c29-a605-33386eb85a9b {{(pid=118906) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:43:52.581019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:52.588457 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-72f52d47-b06d-4faa-950a-d2223e71fa9e tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 200 len: 1184 microversion: 2.1 time: 0.102840 Oct 27 01:43:52.590299 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 593/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:52 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:53.615348 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:53.616040 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:53.622938 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:53.624136 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:53.624585 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:53.625639 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:53.626140 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:53.626604 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:53.639900 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] HTTP exception thrown: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Request method failure captured: Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b HTTP/1.1 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWeGgzgmYL96STbFjE-mto_1TwuIqltvwJQMgmu6I3SfindbBIRZnYhAdQt1ZqC7jxoM9iQ0mdbXMOUP33vUsv9Ld46vbpEHxsJ8Mn9leNXTiKQCtPiXlL2wgX6QQTAeyTytfB1iHl2x2-6WnLAg9PwsyUfpBlQyLE_jcoKBeajclafI Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:43:53.641537 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_897fac8b218c4476b84ea53d3b79e9a7", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-TestVolumeBootPattern-604790581 Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: ed6abf3b558c44f692e3fc95749642a3 Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:43:53.643371 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '4c1bfbf2-3463-4c29-a605-33386eb85a9b'} Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:43:53.644490 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:43:53.646217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:43:53.647898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Returning 404 to user: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:43:53.647898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-606f80b5-e0de-4523-8409-4e5d820fec1f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 404 len: 111 microversion: 2.1 time: 0.033643 Oct 27 01:43:53.647898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 579/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:53 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:43:53.690939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-771504597", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1533663802", "security_groups": [{"name": "tempest-secgroup-smoke-1446069843"}], "block_device_mapping_v2": [{"uuid": "d3b8da70-3865-4caf-be9d-8d61a862209f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ddef7af7-3a37-424a-bbe6-e1306854800a"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:43:53.804273 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] validate_networks() for [('ddef7af7-3a37-424a-bbe6-e1306854800a', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:43:54.164087 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:43:54.164507 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:43:54.164975 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:43:54.165419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:43:54.165822 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:43:54.175108 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:54.175586 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:54.176019 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:54.176743 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:54.177224 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:54.177649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:54.194814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:43:54.199424 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for user ed6abf3b558c44f692e3fc95749642a3 and project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:43:54.255493 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:43:54.257649 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3b8da70-3865-4caf-be9d-8d61a862209f',volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:43:54.385433 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-01d81988-b1bf-46ee-b134-4dc308f18d62 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698216 Oct 27 01:43:54.387339 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 594/1173] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:43:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:43:54.398106 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b1cf86a5-03c9-4d09-95cc-e72702d82392 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:54.398720 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b1cf86a5-03c9-4d09-95cc-e72702d82392 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:54.453414 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b1cf86a5-03c9-4d09-95cc-e72702d82392 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:54.460341 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b1cf86a5-03c9-4d09-95cc-e72702d82392 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1094 microversion: 2.1 time: 0.066015 Oct 27 01:43:54.460928 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 580/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:54 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:55.484178 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-451c5e1e-ad76-4624-9b2c-16c89ca5dcaf tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:55.485008 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-451c5e1e-ad76-4624-9b2c-16c89ca5dcaf tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:55.538364 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-451c5e1e-ad76-4624-9b2c-16c89ca5dcaf tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:55.546938 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-451c5e1e-ad76-4624-9b2c-16c89ca5dcaf tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1094 microversion: 2.1 time: 0.067141 Oct 27 01:43:55.547505 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 595/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:55 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:56.570022 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c37628ed-dd39-4b79-9064-a732d8e1fe8d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:56.570646 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c37628ed-dd39-4b79-9064-a732d8e1fe8d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:56.629877 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c37628ed-dd39-4b79-9064-a732d8e1fe8d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:56.637457 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c37628ed-dd39-4b79-9064-a732d8e1fe8d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1094 microversion: 2.1 time: 0.071145 Oct 27 01:43:56.637942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 581/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:56 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:57.659865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-003a8b14-09ac-4f2f-ac4b-27b453bf5a76 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:57.660471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-003a8b14-09ac-4f2f-ac4b-27b453bf5a76 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:57.716403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-003a8b14-09ac-4f2f-ac4b-27b453bf5a76 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:57.723312 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-003a8b14-09ac-4f2f-ac4b-27b453bf5a76 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1094 microversion: 2.1 time: 0.067448 Oct 27 01:43:57.723912 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 596/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:57 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:58.747472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:58.748110 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:58.754526 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:58.755004 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:58.755437 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:58.756117 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:58.756564 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:58.756987 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:58.818845 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:58.827185 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b0651db7-a6ef-433a-b7e0-075c58d86c4b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1144 microversion: 2.1 time: 0.084286 Oct 27 01:43:58.827800 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 582/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:58 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:43:59.850825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:43:59.851919 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:43:59.859229 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:59.859707 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:59.860138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:59.860865 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:43:59.861331 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:43:59.861755 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:43:59.934381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:43:59.941898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-53efce28-e4cd-416c-9a55-41edc1ee8748 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1210 microversion: 2.1 time: 0.095161 Oct 27 01:43:59.942471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 597/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:43:59 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:00.966296 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:00.966914 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:00.973955 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:00.974444 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:00.975069 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:00.975777 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:00.976236 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:00.976668 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:01.169410 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:01.177011 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-8e8c6272-3df0-47a4-b094-7470a37133f4 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.215033 Oct 27 01:44:01.177603 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 583/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:00 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:01.247801 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622d536c-f1ec-420f-9a53-b69814477d51", "tag": "b53b8dd8-136d-4439-b89c-b0504e67a544"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:44:01.258018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:01.259413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:01.259862 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:01.270926 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] Creating event network-changed:b53b8dd8-136d-4439-b89c-b0504e67a544 for instance 622d536c-f1ec-420f-9a53-b69814477d51 on hv-cinder-81558 Oct 27 01:44:01.275767 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-d552351f-4cda-4b69-a6eb-b8e339844a0c req-383e69e4-3193-4c6d-9ee4-d4f78b935e5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Oct 27 01:44:01.276381 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 598/1181] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:44:02.201006 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:02.201999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:02.208462 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:02.208937 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:02.209401 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:02.210082 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:02.210524 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:02.210942 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:02.342273 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:02.350299 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-2da4c051-140b-4dc5-9e7f-d5683e9f76e9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.153443 Oct 27 01:44:02.350878 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 584/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:02 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:03.375710 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:03.376476 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:03.382956 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:03.383440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:03.383892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:03.384640 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:03.385121 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:03.385550 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:03.519184 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:03.527535 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-e6876ce9-0240-43ff-a290-1e8871fd0008 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.156666 Oct 27 01:44:03.528100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 599/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:03 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:04.552135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:04.552743 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:04.559584 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:04.560015 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:04.560450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:04.561166 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:04.561623 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:04.562045 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:04.696295 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:04.705044 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ae15e21f-e170-4a49-ad0d-ce3f822c8c35 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.156819 Oct 27 01:44:04.705622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 585/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:04 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:05.729049 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:05.729692 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:05.732258 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:44:05.737966 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:05.738448 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:05.738885 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:05.739575 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:05.740024 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:05.740477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:05.877093 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:05.884665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-8f866a35-685b-4d5e-897a-ba011496a9a9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.159492 Oct 27 01:44:05.885267 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 600/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:05 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:06.907866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:06.908472 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:06.910860 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=4 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:44:06.916181 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:06.916650 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:06.917094 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:06.917774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:06.918841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:06.919425 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:07.054995 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:07.062841 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e3cc9bed-3f7b-425c-a3c8-c1b2d3c03259 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.158974 Oct 27 01:44:07.063423 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 586/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:06 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:08.086035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:08.086624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:08.088895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=10 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:44:08.094824 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:08.095303 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:08.095735 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:08.096422 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:08.096869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:08.097314 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:08.230040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:08.239329 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-6b836948-93dc-4972-924f-0f6ea0ddbe83 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.157121 Oct 27 01:44:08.239959 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 601/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:08 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:09.263730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:09.264729 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:09.270699 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:09.271171 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:09.271599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:09.272304 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:09.272749 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:09.273192 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:09.401238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:09.408898 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c89aef10-01e8-416c-926e-45fb0f621fb2 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.149071 Oct 27 01:44:09.409488 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 587/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:09 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:10.435201 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:10.435814 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:10.442683 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:10.443158 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:10.443589 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:10.444280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:10.444722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:10.445244 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:10.583226 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:10.591037 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-c4816b9c-c6cf-411e-8ee3-9223b159ffec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.159927 Oct 27 01:44:10.591605 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 602/1189] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:10 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:11.614730 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:11.615350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:11.621795 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:11.622268 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:11.622700 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:11.623380 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:11.623819 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:11.624238 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:11.754372 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:11.762080 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7e3f0ec5-0bec-4b2b-b2ef-d7b3da49fc9a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.151220 Oct 27 01:44:11.762648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 588/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:11 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:44:12.593089 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622d536c-f1ec-420f-9a53-b69814477d51", "name": "network-vif-plugged", "status": "completed", "tag": "b53b8dd8-136d-4439-b89c-b0504e67a544"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:44:12.603622 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:12.604113 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:12.604548 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:12.616778 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] Creating event network-vif-plugged:b53b8dd8-136d-4439-b89c-b0504e67a544 for instance 622d536c-f1ec-420f-9a53-b69814477d51 on hv-cinder-81558 Oct 27 01:44:12.621831 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-3cfe55af-5bf8-448d-80f6-98e436af25c6 req-7d86768f-a297-4ce0-b23e-739e68ce799b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Oct 27 01:44:12.622607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 603/1191] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:44:12.786573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:12.787340 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:12.793550 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:12.794024 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:12.794453 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:12.795135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:12.795582 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:12.796000 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:12.998581 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:13.006703 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-07d8e49d-c7b4-4357-8236-8514f97d4933 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.224046 Oct 27 01:44:13.007264 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 589/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:12 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:14.029773 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:14.030459 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:14.037987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:14.038461 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:14.038892 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:14.039603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:14.040107 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:14.040537 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:14.172081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:14.180472 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-497e75b0-9b70-4fef-abc9-313a85e6ee2f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1266 microversion: 2.1 time: 0.155401 Oct 27 01:44:14.181033 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 604/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:14 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:15.204012 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:15.204707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:15.211221 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:15.211700 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:15.212135 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:15.212851 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:15.213330 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:15.213756 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:15.345377 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:15.352996 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-74abfa21-b9f8-4e89-97a6-7fa763d03636 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1452 microversion: 2.1 time: 0.152986 Oct 27 01:44:15.353614 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 590/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:15 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:44:15.376579 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:44:15.377269 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:44:15.383560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:15.384038 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:15.384474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:15.385192 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:15.385645 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:15.386067 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:15.514789 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:44:15.522895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7ddfc564-291a-4088-a3f6-009c5ba2be4c tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1452 microversion: 2.1 time: 0.150787 Oct 27 01:44:15.523514 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 605/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:44:15 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:44:17.128506 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622d536c-f1ec-420f-9a53-b69814477d51", "tag": "b53b8dd8-136d-4439-b89c-b0504e67a544"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:44:17.138419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:44:17.138888 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:44:17.139321 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:44:17.150625 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] Creating event network-changed:b53b8dd8-136d-4439-b89c-b0504e67a544 for instance 622d536c-f1ec-420f-9a53-b69814477d51 on hv-cinder-81558 Oct 27 01:44:17.155748 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-38ef31d2-b742-4091-9b5e-749e5537dbd9 req-0b4e1e2a-14d6-4138-88da-092649c66619 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030883 Oct 27 01:44:17.156454 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 591/1196] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:46:17.484440 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:17.485265 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=68 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:17.491128 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-564877196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1533663802", "security_groups": [{"name": "tempest-secgroup-smoke-1446069843"}], "block_device_mapping_v2": [{"uuid": "ad30fff5-1f0e-4fbc-ba9d-ea286dd61f34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ddef7af7-3a37-424a-bbe6-e1306854800a"}]}} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:46:17.687278 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.network.neutron [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] validate_networks() for [('ddef7af7-3a37-424a-bbe6-e1306854800a', None, None, None, None, None)] {{(pid=118906) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 01:46:18.116924 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 01:46:18.117364 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image limits 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 01:46:18.117830 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Flavor pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 01:46:18.118231 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Image pref 0:0:0 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 01:46:18.118634 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.virt.hardware [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118906) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 01:46:18.128309 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:18.128782 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:18.129248 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:18.129968 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:18.130419 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:18.130842 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:18.148018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 01:46:18.152408 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.quota [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Getting quotas for user ed6abf3b558c44f692e3fc95749642a3 and project 897fac8b218c4476b84ea53d3b79e9a7. Resources: {'instances', 'cores', 'ram'} {{(pid=118906) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 01:46:18.209247 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Going to run 1 instances... {{(pid=118906) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 01:46:18.211327 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad30fff5-1f0e-4fbc-ba9d-ea286dd61f34',volume_size=None,volume_type=None)] {{(pid=118906) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 01:46:18.342332 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-ad70e6d8-9efa-4903-9eea-d799dd99377a tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.859921 Oct 27 01:46:18.342963 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 606/1197] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Oct 27 01:46:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 01:46:18.352456 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:18.353250 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:18.354477 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:46:18.354786 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Thu Oct 27 01:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 (ip 10.222.0.42) !!! Oct 27 01:46:18.361727 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-811d8874-84b0-45f1-8d31-8340d0c8b375 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:18.362450 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-811d8874-84b0-45f1-8d31-8340d0c8b375 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:18.472813 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-811d8874-84b0-45f1-8d31-8340d0c8b375 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:18.480298 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-811d8874-84b0-45f1-8d31-8340d0c8b375 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1094 microversion: 2.1 time: 0.130018 Oct 27 01:46:18.480866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 592/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:18 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:19.503906 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:19.504500 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:19.511213 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:19.511691 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:19.512126 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:19.512816 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:19.513294 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:19.513722 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:19.575035 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:19.582751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-1d024d0f-adbb-421c-b309-365686cebc3b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1200 microversion: 2.1 time: 0.083415 Oct 27 01:46:19.583306 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 607/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:19 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:20.607684 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:20.609018 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:20.619148 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:20.619932 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:20.620315 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:20.621167 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:20.621871 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:20.626973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:20.867707 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:20.875875 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-484af224-f827-48df-8b00-31095226042b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.273796 Oct 27 01:46:20.876441 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 593/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:20 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:21.368846 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740814ed-f20d-4cfc-bfb9-7206661ba280", "tag": "79d43a95-d519-4f5f-bf73-9f16392bffe3"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:46:21.380160 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:21.380632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:21.381090 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:21.393411 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] Creating event network-changed:79d43a95-d519-4f5f-bf73-9f16392bffe3 for instance 740814ed-f20d-4cfc-bfb9-7206661ba280 on hv-cinder-81558 Oct 27 01:46:21.398413 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-0a9c04d7-643a-424e-8876-10a43086aa3d req-d927f568-92c8-4e27-b57e-0330c85249d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083414 Oct 27 01:46:21.399266 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 608/1201] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:46:21.899895 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:21.900985 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:21.907724 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:21.908209 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:21.908648 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:21.909374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:21.909830 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:21.910262 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:22.040662 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:22.048270 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c95baf73-da01-49dd-a320-5d5d36f2c422 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.152380 Oct 27 01:46:22.048838 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 594/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:21 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:23.072786 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:23.073417 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:23.079987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:23.080462 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:23.080898 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:23.081610 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:23.082057 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:23.082477 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:23.259104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:23.267023 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-7df6b6fe-e2f4-4a6d-b0a3-a72bb1b31cc1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.198501 Oct 27 01:46:23.267573 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 609/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:23 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:24.290642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:24.291770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:24.298097 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:24.298579 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:24.299016 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:24.299705 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:24.300155 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:24.300602 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:24.432962 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:24.440801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-37544bc4-7808-495d-8c38-4835fcb8b7f9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.154211 Oct 27 01:46:24.441416 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 595/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:24 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:25.464295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:25.464895 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:25.471945 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:25.472435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:25.472877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:25.473611 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:25.474064 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:25.474488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:25.602171 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:25.610542 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-95e05d65-4bac-41b8-a775-5aae499aaf93 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.151118 Oct 27 01:46:25.611114 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 610/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:25 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:26.633629 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:26.634207 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:26.640552 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:26.641035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:26.641501 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:26.642188 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:26.642635 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:26.643059 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:26.771408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:26.779626 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-e9d579ef-9165-4402-a7ed-76838383deb6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.150226 Oct 27 01:46:26.780191 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 596/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:26 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:27.803030 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:27.803639 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:27.810830 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:27.811315 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:27.811751 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:27.812446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:27.812897 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:27.813345 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:27.944982 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:27.953451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-58fa59e0-4788-4707-bd5c-ae9753d920ca tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.154204 Oct 27 01:46:27.954025 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 611/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:27 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:28.976770 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:28.977505 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:28.980402 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell0:SELECT=2 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:28.986196 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:28.986691 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:28.987128 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:28.987862 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:28.988316 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:28.988774 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:29.120912 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:29.128574 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b6c12eb6-1aaf-4a9a-915d-562541f6a268 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.155864 Oct 27 01:46:29.129163 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 597/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:28 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:30.153275 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:30.153812 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:30.155742 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=2 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:30.156521 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell0:SELECT=6 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:46:30.162527 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:30.163010 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:30.163446 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:30.164138 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:30.164592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:30.165018 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:30.300597 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:30.308688 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f0041f75-051a-46e5-b72d-ead5f22a37da tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.160393 Oct 27 01:46:30.309563 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 612/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:30 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:46:31.332353 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:31.332982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:31.340388 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:31.340864 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:31.341332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:31.342131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:31.342563 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:31.342980 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:31.477863 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:31.486892 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-7e3722d3-2acf-44ed-a485-b16828a0f1d3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.158397 Oct 27 01:46:31.487481 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 598/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:31 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:32.513993 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:32.514598 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:32.520942 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:32.521451 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:32.521883 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:32.522569 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:32.523012 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:32.523436 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:32.657444 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:32.665028 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-a0ddf63b-27cf-4444-9e34-7c89796e88f1 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.155388 Oct 27 01:46:32.666129 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 613/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:32 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:33.466551 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740814ed-f20d-4cfc-bfb9-7206661ba280", "name": "network-vif-plugged", "status": "completed", "tag": "79d43a95-d519-4f5f-bf73-9f16392bffe3"}]} {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:46:33.477896 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:33.478643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:33.479834 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:33.493113 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.compute.server_external_events [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] Creating event network-vif-plugged:79d43a95-d519-4f5f-bf73-9f16392bffe3 for instance 740814ed-f20d-4cfc-bfb9-7206661ba280 on hv-cinder-81558 Oct 27 01:46:33.496498 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR oslo.messaging._drivers.impl_rabbit [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] [4fc44763-820b-4726-943f-127facd383ee] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 01:46:33.688438 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:33.689077 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:33.695488 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:33.695974 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:33.696418 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:33.697740 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:33.698217 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:33.698648 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:33.827771 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:33.835379 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-2b94196c-bbf2-424c-9ba3-fe280540f2fa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.151042 Oct 27 01:46:33.835949 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 614/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:33 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:46:34.503642 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] [4fc44763-820b-4726-943f-127facd383ee] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60224. Oct 27 01:46:34.507346 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [req-92ffeb0a-fa15-4942-afca-0adc26e1e2ae req-6d33a187-3210-4e7b-90bd-01432f264b49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.097173 Oct 27 01:46:34.507982 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 599/1213] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:46:34.858403 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:34.859041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:34.865382 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:34.865873 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:34.866311 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:34.867005 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:34.867458 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:34.867887 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:35.000355 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:35.008047 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-b225a751-700d-414a-9a35-b8a38b912731 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.153591 Oct 27 01:46:35.008603 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 615/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:34 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:36.033479 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:36.034169 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:36.040208 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:36.040681 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:36.041138 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:36.041817 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:36.042946 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:36.043519 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:36.175374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:36.183392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-04fe0749-f280-47cf-960b-89e71ce1a0b3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1266 microversion: 2.1 time: 0.154560 Oct 27 01:46:36.183958 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 600/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:36 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:37.206189 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:37.206794 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:37.213187 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:37.213665 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:37.214100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:37.214792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:37.215237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:37.215654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:37.348614 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:37.357441 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-d3cd5a51-67c5-41d1-8a4e-6b96cdca21aa tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1452 microversion: 2.1 time: 0.155103 Oct 27 01:46:37.357997 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 616/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:37 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:37.379363 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:46:37.379974 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:46:37.386613 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:37.387099 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:37.387536 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:37.388228 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:37.388679 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:37.389129 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:37.517973 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:46:37.525631 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-f7aabf8b-90ea-4ab5-b4ae-f759db8213c6 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1452 microversion: 2.1 time: 0.150089 Oct 27 01:46:37.526198 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 601/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:46:37 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:46:39.472977 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740814ed-f20d-4cfc-bfb9-7206661ba280", "tag": "79d43a95-d519-4f5f-bf73-9f16392bffe3"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:46:39.486487 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:46:39.487139 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:46:39.487939 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:46:39.500934 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] Creating event network-changed:79d43a95-d519-4f5f-bf73-9f16392bffe3 for instance 740814ed-f20d-4cfc-bfb9-7206661ba280 on hv-cinder-81558 Oct 27 01:46:39.514144 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-558db845-7f23-4aaf-9bd0-be9f2748c5fe req-112e1501-90f4-44e4-a92f-9273a4c8d17f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045808 Oct 27 01:46:39.515041 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 617/1218] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:48:29.769653 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_api:SELECT=22 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:48:29.770576 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG dbcounter [-] [118905] Writing DB stats nova_cell1:SELECT=50 {{(pid=118905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:48:29.771512 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:48:29.771737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Thu Oct 27 01:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 (ip 10.222.0.42) !!! Oct 27 01:48:29.775471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36e8b976-9974-4d8b-8471-f235613bf5ae] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 01:48:29.776078 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:48:29.776994 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG dbcounter [-] [118906] Writing DB stats nova_cell1:SELECT=60 {{(pid=118906) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 01:48:29.777440 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:29.777852 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:29.778825 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 01:48:29.779015 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Thu Oct 27 01:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 27 01:48:29.786674 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740814ed-f20d-4cfc-bfb9-7206661ba280", "tag": "79d43a95-d519-4f5f-bf73-9f16392bffe3"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:48:29.786905 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:29.787176 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:29.787622 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:29.788323 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:29.789229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:29.789229 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:29.806048 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:29.806357 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:29.806775 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:29.818051 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:48:29.827119 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] Creating event network-changed:79d43a95-d519-4f5f-bf73-9f16392bffe3 for instance 740814ed-f20d-4cfc-bfb9-7206661ba280 on hv-cinder-81558 Oct 27 01:48:29.832474 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-203e0c20-bbcd-4faa-a937-0bfdba7a7c03 req-666f1ca1-58b9-4662-8ecb-d3a6a74b67e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062203 Oct 27 01:48:29.836450 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 618/1219] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 01:48:29.902324 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-1281c3ef-0a37-4521-9d1b-0ef97eaba5d9 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "DELETE /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 204 len: 0 microversion: 2.1 time: 0.133842 Oct 27 01:48:29.906846 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 602/1220] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:48:29 2022] DELETE /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:48:29.913849 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:29.914557 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:29.921566 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:29.923632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:29.923632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:29.923632 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:29.923970 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:29.924280 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:30.062052 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:30.069699 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-4968bc8a-c3d6-4e0c-a02f-23264e06ee6b tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1576 microversion: 2.1 time: 0.161228 Oct 27 01:48:30.070455 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 619/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:29 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 01:48:31.094408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:31.095017 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:31.101760 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:31.102245 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:31.102678 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:31.103358 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:31.103801 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:31.104217 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:31.268951 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:31.277482 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-503b3e82-e547-453f-bb5d-82cab81b71b0 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1576 microversion: 2.1 time: 0.187237 Oct 27 01:48:31.278058 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 603/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:31 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:48:32.201104 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO oslo.messaging._drivers.impl_rabbit [-] [36e8b976-9974-4d8b-8471-f235613bf5ae] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60294. Oct 27 01:48:32.251471 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740814ed-f20d-4cfc-bfb9-7206661ba280", "name": "network-vif-deleted", "tag": "79d43a95-d519-4f5f-bf73-9f16392bffe3"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:48:32.261953 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:32.262443 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:32.262872 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:32.275081 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] Creating event network-vif-deleted:79d43a95-d519-4f5f-bf73-9f16392bffe3 for instance 740814ed-f20d-4cfc-bfb9-7206661ba280 on hv-cinder-81558 Oct 27 01:48:32.280938 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-5368a043-a602-4f07-abb6-847c1b65f112 req-89d6a543-4fff-4ca6-8b3c-23ff247d9c46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094685 Oct 27 01:48:32.281560 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 620/1223] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:48:32.301737 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:32.302350 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:32.309593 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:32.310078 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:32.310521 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:32.311220 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:32.311676 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:32.312104 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:32.373332 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:32.381053 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-c2de5610-4aa7-4fa9-b993-27492cf8f5cb tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 200 len: 1225 microversion: 2.1 time: 0.083245 Oct 27 01:48:32.381643 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 604/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:32 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:48:33.405042 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:33.405679 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 740814ed-f20d-4cfc-bfb9-7206661ba280] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:33.412219 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:33.412696 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:33.413153 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:33.413839 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:33.414284 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:33.414703 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:33.428664 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] HTTP exception thrown: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Request method failure captured: Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 HTTP/1.1 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeGgzgmYL96STbFjE-mto_1TwuIqltvwJQMgmu6I3SfindbBIRZnYhAdQt1ZqC7jxoM9iQ0mdbXMOUP33vUsv9Ld46vbpEHxsJ8Mn9leNXTiKQCtPiXlL2wgX6QQTAeyTytfB1iHl2x2-6WnLAg9PwsyUfpBlQyLE_jcoKBeajclafI Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:48:33.430295 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_897fac8b218c4476b84ea53d3b79e9a7", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: ed6abf3b558c44f692e3fc95749642a3 Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. Oct 27 01:48:33.431989 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '740814ed-f20d-4cfc-bfb9-7206661ba280'} Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:48:33.433593 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. Oct 27 01:48:33.435659 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:33.437207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Returning 404 to user: Instance 740814ed-f20d-4cfc-bfb9-7206661ba280 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:48:33.437207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-0696d5a7-7e17-474c-96b5-c05c22c1648f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280" status: 404 len: 111 microversion: 2.1 time: 0.031484 Oct 27 01:48:33.437207 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 621/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:33 2022] GET /compute/v2.1/servers/740814ed-f20d-4cfc-bfb9-7206661ba280 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:48:36.501012 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:36.501544 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:36.505239 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622d536c-f1ec-420f-9a53-b69814477d51", "tag": "b53b8dd8-136d-4439-b89c-b0504e67a544"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:48:36.508035 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:36.508513 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:36.508949 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:36.509686 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:36.510131 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:36.511225 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:36.515972 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:36.516515 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:36.517200 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:36.531544 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] Creating event network-changed:b53b8dd8-136d-4439-b89c-b0504e67a544 for instance 622d536c-f1ec-420f-9a53-b69814477d51 on hv-cinder-81558 Oct 27 01:48:36.536608 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-b564654a-7f3c-4827-94d3-6092012acaa2 req-b7c84b2b-020e-44ca-8540-0e47b6f75d3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035566 Oct 27 01:48:36.540237 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 622/1226] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:48:36.540630 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Going to try to terminate instance {{(pid=118905) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 01:48:36.630205 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-b2fe48cd-c1f9-4ed3-9051-8c8014bfe70f tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "DELETE /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 204 len: 0 microversion: 2.1 time: 0.131771 Oct 27 01:48:36.631284 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 605/1227] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:48:36 2022] DELETE /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 01:48:36.640336 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:36.641040 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:36.647361 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:36.647951 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:36.648435 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:36.649170 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:36.649987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:36.650571 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:36.784646 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.policy [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118906) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:36.792792 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-932beeb9-031f-43a6-9229-ef03a3a7d544 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1577 microversion: 2.1 time: 0.156486 Oct 27 01:48:36.793029 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 623/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:36 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:48:37.817682 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:37.818378 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:37.825374 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:37.825848 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:37.826278 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:37.826956 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:37.827400 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:37.827815 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:38.228753 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:38.237408 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-ae323ef9-a4df-429d-b2d8-432887dda816 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1577 microversion: 2.1 time: 0.423934 Oct 27 01:48:38.237967 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 606/1229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:37 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1577 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:48:38.913973 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622d536c-f1ec-420f-9a53-b69814477d51", "name": "network-vif-deleted", "tag": "b53b8dd8-136d-4439-b89c-b0504e67a544"}]} {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 01:48:38.924607 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:38.925109 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:38.925545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:38.936790 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.compute.server_external_events [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] Creating event network-vif-deleted:b53b8dd8-136d-4439-b89c-b0504e67a544 for instance 622d536c-f1ec-420f-9a53-b69814477d51 on hv-cinder-81558 Oct 27 01:48:38.941592 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [req-855b2417-a151-4c70-b793-26b55b741ede req-779a3422-6f7f-4d47-b075-b2575396895f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Oct 27 01:48:38.942270 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 624/1230] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Oct 27 01:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 01:48:39.261891 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:39.262573 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:39.269395 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:39.269872 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:39.270303 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:39.270999 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:39.271630 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:39.271992 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:39.308150 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:39.308698 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:39.309419 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:39.309866 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.objects.instance [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lazy-loading 'fault' on Instance uuid 622d536c-f1ec-420f-9a53-b69814477d51 {{(pid=118905) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 01:48:39.353713 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.policy [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6abf3b558c44f692e3fc95749642a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897fac8b218c4476b84ea53d3b79e9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118905) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 01:48:39.362119 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-43720f76-76b1-44b6-a4ba-6da1df9ee8ec tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 200 len: 1230 microversion: 2.1 time: 0.105013 Oct 27 01:48:39.362695 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 607/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:39 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 01:48:40.387319 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:40.389641 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 622d536c-f1ec-420f-9a53-b69814477d51] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:40.396070 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.396556 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.397499 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.398202 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.398654 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.399082 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.417100 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] HTTP exception thrown: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Request method failure captured: Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 HTTP/1.1 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeGgzgmYL96STbFjE-mto_1TwuIqltvwJQMgmu6I3SfindbBIRZnYhAdQt1ZqC7jxoM9iQ0mdbXMOUP33vUsv9Ld46vbpEHxsJ8Mn9leNXTiKQCtPiXlL2wgX6QQTAeyTytfB1iHl2x2-6WnLAg9PwsyUfpBlQyLE_jcoKBeajclafI Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:48:40.418952 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_897fac8b218c4476b84ea53d3b79e9a7", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: ed6abf3b558c44f692e3fc95749642a3 Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. Oct 27 01:48:40.420731 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '622d536c-f1ec-420f-9a53-b69814477d51'} Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:48:40.421869 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. Oct 27 01:48:40.423341 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.424877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Returning 404 to user: Instance 622d536c-f1ec-420f-9a53-b69814477d51 could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:48:40.424877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-f764374f-9eab-41c7-bd7a-c0f62bea39f7 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51" status: 404 len: 111 microversion: 2.1 time: 0.038122 Oct 27 01:48:40.424877 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 625/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:40 2022] GET /compute/v2.1/servers/622d536c-f1ec-420f-9a53-b69814477d51 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:48:40.892609 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:40.893141 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.compute.api [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118905) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:40.899494 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.899977 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.900406 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.901156 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.901897 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.902321 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG oslo_concurrency.lockutils [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.915261 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.wsgi [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] HTTP exception thrown: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Request method failure captured: Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: request: DELETE /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b HTTP/1.1 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept: application/json Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Accept-Encoding: identity Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Connection: close Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Length: 0 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Content-Type: application/json Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Host: 10.222.0.42 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: Openstack-System-Scope: None Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: User-Agent: python-urllib3/1.26.12 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Auth-Token: gAAAAABjWeGgzgmYL96STbFjE-mto_1TwuIqltvwJQMgmu6I3SfindbBIRZnYhAdQt1ZqC7jxoM9iQ0mdbXMOUP33vUsv9Ld46vbpEHxsJ8Mn9leNXTiKQCtPiXlL2wgX6QQTAeyTytfB1iHl2x2-6WnLAg9PwsyUfpBlQyLE_jcoKBeajclafI Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Id: None Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Domain-Name: None Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Identity-Status: Confirmed Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Is-Admin-Project: True Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Id: default Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Domain-Name: Default Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Project-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Role: member,reader Oct 27 01:48:40.917575 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Roles: member,reader Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_897fac8b218c4476b84ea53d3b79e9a7", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-Tenant-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Id: default Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Domain-Name: Default Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Id: ed6abf3b558c44f692e3fc95749642a3 Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: X-User-Name: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: method: > Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: exception: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.919392 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: action_args: {'id': '4c1bfbf2-3463-4c29-a605-33386eb85a9b'} Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:48:40.920241 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.921655 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.923028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Returning 404 to user: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. {{(pid=118905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:48:40.923028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-0a15b865-bc06-4b16-ae47-1242c34a2b2d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 404 len: 111 microversion: 2.1 time: 0.030551 Oct 27 01:48:40.923028 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 608/1233] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Oct 27 01:48:40 2022] DELETE /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:48:40.927545 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '>' {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:40.928157 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.compute.api [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] [instance: 4c1bfbf2-3463-4c29-a605-33386eb85a9b] Fetching instance by UUID {{(pid=118906) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 01:48:40.935013 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.935494 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.935930 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.936624 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Acquiring lock "79e0fc89-c477-4f65-9016-7985d4fd2534" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 01:48:40.937095 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 01:48:40.937528 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG oslo_concurrency.lockutils [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Lock "79e0fc89-c477-4f65-9016-7985d4fd2534" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 01:48:40.950987 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.wsgi [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] HTTP exception thrown: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Request method failure captured: Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: request: GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b HTTP/1.1 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept: application/json Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Accept-Encoding: identity Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Connection: close Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Length: 0 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Content-Type: application/json Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Host: 10.222.0.42 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: Openstack-System-Scope: None Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: User-Agent: python-urllib3/1.26.12 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Auth-Token: gAAAAABjWeGgzgmYL96STbFjE-mto_1TwuIqltvwJQMgmu6I3SfindbBIRZnYhAdQt1ZqC7jxoM9iQ0mdbXMOUP33vUsv9Ld46vbpEHxsJ8Mn9leNXTiKQCtPiXlL2wgX6QQTAeyTytfB1iHl2x2-6WnLAg9PwsyUfpBlQyLE_jcoKBeajclafI Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Id: None Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Domain-Name: None Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Identity-Status: Confirmed Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Is-Admin-Project: True Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Id: default Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Domain-Name: Default Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Project-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Role: member,reader Oct 27 01:48:40.952538 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Roles: member,reader Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/897fac8b218c4476b84ea53d3b79e9a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_897fac8b218c4476b84ea53d3b79e9a7", "adminURL": "http://10.222.0.42:8080"}]}] Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Id: 897fac8b218c4476b84ea53d3b79e9a7 Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-Tenant-Name: tempest-TestVolumeBootPattern-604790581 Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Id: default Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Domain-Name: Default Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Id: ed6abf3b558c44f692e3fc95749642a3 Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: X-User-Name: tempest-TestVolumeBootPattern-604790581-project Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: method: > Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: exception: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.954304 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: action_args: {'id': '4c1bfbf2-3463-4c29-a605-33386eb85a9b'} Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: {{(pid=118906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 01:48:40.955264 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. Oct 27 01:48:40.956861 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: ERROR nova.api.openstack.wsgi Oct 27 01:48:40.958591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: DEBUG nova.api.openstack.wsgi [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Returning 404 to user: Instance 4c1bfbf2-3463-4c29-a605-33386eb85a9b could not be found. {{(pid=118906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 01:48:40.958591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: INFO nova.api.openstack.requestlog [None req-204371b7-30f1-4c1b-912b-d894687807f3 tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b" status: 404 len: 111 microversion: 2.1 time: 0.030291 Oct 27 01:48:40.958591 dv-cinder-815582-19-iscsi devstack@n-api.service[118906]: [pid: 118906|app: 0|req: 626/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Oct 27 01:48:40 2022] GET /compute/v2.1/servers/4c1bfbf2-3463-4c29-a605-33386eb85a9b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 01:48:42.261665 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: DEBUG nova.api.openstack.wsgi [None req-d880e74a-f5be-4efe-9ae0-96fededc2d1d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] Calling method '.version_select at 0x7f6c12e9e790>' {{(pid=118905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 01:48:42.284599 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: INFO nova.api.openstack.requestlog [None req-d880e74a-f5be-4efe-9ae0-96fededc2d1d tempest-TestVolumeBootPattern-604790581 tempest-TestVolumeBootPattern-604790581-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1533663802" status: 202 len: 0 microversion: 2.1 time: 0.027521 Oct 27 01:48:42.297096 dv-cinder-815582-19-iscsi devstack@n-api.service[118905]: [pid: 118905|app: 0|req: 609/1235] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Oct 27 01:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1533663802 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)